2026-02-13T09:35:26.335 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-13T09:35:26.350 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T09:35:26.426 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47936 branch: wip-bharath17-testing-2026-02-12-0618-tentacle description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} email: skanta@redhat.com first_in_suite: false flavor: default job_id: '47936' kernel: branch: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: trial name: skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath17-testing-2026-02-12-0618-tentacle ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb workunit: branch: wip-bharath17-testing-2026-02-12-0618-tentacle sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb owner: scheduled_skanta@soko04.front.sepia.ceph.com priority: 80 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 2723 sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath17-testing-2026-02-12-0618-tentacle suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb targets: trial010.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHMbuGYYfGCLEMcnaPZ6r25I7Zye+pt2KTGqJO5lzVlBBzmhp3+uq0Y0Tstv/ApUxf8NM/o3nUjMJhJwKW2I0aY= tasks: - install: null - workunit: basedir: qa/standalone clients: all: - osd teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-13_01:43:11 tube: trial user: skanta verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T09:35:26.426 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa; will attempt to use it 2026-02-13T09:35:26.426 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa/tasks 2026-02-13T09:35:26.426 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T09:35:26.428 INFO:teuthology.task.internal:Checking packages... 2026-02-13T09:35:26.428 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb' 2026-02-13T09:35:26.428 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T09:35:26.428 INFO:teuthology.packaging:ref: None 2026-02-13T09:35:26.428 INFO:teuthology.packaging:tag: None 2026-02-13T09:35:26.428 INFO:teuthology.packaging:branch: wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T09:35:26.428 INFO:teuthology.packaging:sha1: 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T09:35:26.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T09:35:26.544 INFO:teuthology.task.internal:Found packages for ceph version 20.2.0-636-g3b40640f-1jammy 2026-02-13T09:35:26.545 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T09:35:26.557 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T09:35:26.557 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T09:35:26.570 INFO:teuthology.task.internal:Saving configuration 2026-02-13T09:35:26.578 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T09:35:26.589 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T09:35:26.667 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial010.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47936', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 09:32:05.535757', 'locked_by': 'scheduled_skanta@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKsQAgkBnsyNXMo4bSoLxylJl+P9whyd0o9Qz1dfdf1A'} 2026-02-13T09:35:26.667 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T09:35:26.678 INFO:teuthology.task.internal:roles: ubuntu@trial010.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2026-02-13T09:35:26.678 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T09:35:26.764 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x740e1c49ce00>, signals=[15]) 2026-02-13T09:35:26.764 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T09:35:26.775 INFO:teuthology.task.internal:Opening connections... 2026-02-13T09:35:26.775 DEBUG:teuthology.task.internal:connecting to ubuntu@trial010.front.sepia.ceph.com 2026-02-13T09:35:26.776 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T09:35:26.838 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T09:35:26.853 DEBUG:teuthology.orchestra.run.trial010:> uname -m 2026-02-13T09:35:26.917 INFO:teuthology.orchestra.run.trial010.stdout:x86_64 2026-02-13T09:35:26.917 DEBUG:teuthology.orchestra.run.trial010:> cat /etc/os-release 2026-02-13T09:35:26.960 INFO:teuthology.orchestra.run.trial010.stdout:PRETTY_NAME="Ubuntu 22.04.5 LTS" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:NAME="Ubuntu" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:VERSION_ID="22.04" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:VERSION="22.04.5 LTS (Jammy Jellyfish)" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:VERSION_CODENAME=jammy 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:ID=ubuntu 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:ID_LIKE=debian 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:HOME_URL="https://www.ubuntu.com/" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2026-02-13T09:35:26.961 INFO:teuthology.orchestra.run.trial010.stdout:UBUNTU_CODENAME=jammy 2026-02-13T09:35:26.962 INFO:teuthology.lock.ops:Updating trial010.front.sepia.ceph.com on lock server 2026-02-13T09:35:27.048 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T09:35:27.060 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T09:35:27.073 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T09:35:27.073 DEBUG:teuthology.orchestra.run.trial010:> test '!' -e /home/ubuntu/cephtest 2026-02-13T09:35:27.077 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T09:35:27.087 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T09:35:27.087 DEBUG:teuthology.orchestra.run.trial010:> test -z $(ls -A /var/lib/ceph) 2026-02-13T09:35:27.122 INFO:teuthology.orchestra.run.trial010.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2026-02-13T09:35:27.123 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T09:35:27.218 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T09:35:27.239 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-13T09:35:27.239 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-13T09:35:27.240 DEBUG:teuthology.orchestra.run.trial010:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T09:35:27.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T09:35:27.243 DEBUG:teuthology.orchestra.run.trial010:> uname -r 2026-02-13T09:35:27.289 INFO:teuthology.orchestra.run.trial010.stdout:5.15.0-164-generic 2026-02-13T09:35:27.289 INFO:teuthology.task.kernel:Running kernel on trial010: 5.15.0-164-generic 2026-02-13T09:35:27.289 DEBUG:teuthology.orchestra.run.trial010:> sudo apt-get clean 2026-02-13T09:35:27.347 DEBUG:teuthology.orchestra.run.trial010:> sudo apt-get update 2026-02-13T09:35:27.848 INFO:teuthology.orchestra.run.trial010.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T09:35:27.937 INFO:teuthology.orchestra.run.trial010.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2026-02-13T09:35:28.273 INFO:teuthology.orchestra.run.trial010.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2026-02-13T09:35:28.420 INFO:teuthology.orchestra.run.trial010.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2026-02-13T09:35:28.559 INFO:teuthology.orchestra.run.trial010.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [3226 kB] 2026-02-13T09:35:28.958 INFO:teuthology.orchestra.run.trial010.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [492 kB] 2026-02-13T09:35:28.970 INFO:teuthology.orchestra.run.trial010.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [19.1 kB] 2026-02-13T09:35:28.971 INFO:teuthology.orchestra.run.trial010.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1254 kB] 2026-02-13T09:35:29.005 INFO:teuthology.orchestra.run.trial010.stdout:Get:9 https://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [313 kB] 2026-02-13T09:35:29.012 INFO:teuthology.orchestra.run.trial010.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [30.3 kB] 2026-02-13T09:35:29.013 INFO:teuthology.orchestra.run.trial010.stdout:Get:11 https://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [5260 kB] 2026-02-13T09:35:29.167 INFO:teuthology.orchestra.run.trial010.stdout:Get:12 https://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [991 kB] 2026-02-13T09:35:29.191 INFO:teuthology.orchestra.run.trial010.stdout:Get:13 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 Packages [2959 kB] 2026-02-13T09:35:29.275 INFO:teuthology.orchestra.run.trial010.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy-security/main Translation-en [425 kB] 2026-02-13T09:35:29.285 INFO:teuthology.orchestra.run.trial010.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [14.1 kB] 2026-02-13T09:35:29.286 INFO:teuthology.orchestra.run.trial010.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [1017 kB] 2026-02-13T09:35:29.317 INFO:teuthology.orchestra.run.trial010.stdout:Get:17 https://archive.ubuntu.com/ubuntu jammy-security/universe Translation-en [224 kB] 2026-02-13T09:35:29.324 INFO:teuthology.orchestra.run.trial010.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [22.6 kB] 2026-02-13T09:35:29.325 INFO:teuthology.orchestra.run.trial010.stdout:Get:19 https://archive.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [5089 kB] 2026-02-13T09:35:29.473 INFO:teuthology.orchestra.run.trial010.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-security/restricted Translation-en [963 kB] 2026-02-13T09:35:32.674 INFO:teuthology.orchestra.run.trial010.stdout:Fetched 22.7 MB in 3s (7862 kB/s) 2026-02-13T09:35:33.195 INFO:teuthology.orchestra.run.trial010.stdout:Reading package lists... 2026-02-13T09:35:33.209 DEBUG:teuthology.orchestra.run.trial010:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T09:35:33.242 INFO:teuthology.orchestra.run.trial010.stdout:Reading package lists... 2026-02-13T09:35:33.351 INFO:teuthology.orchestra.run.trial010.stdout:Building dependency tree... 2026-02-13T09:35:33.352 INFO:teuthology.orchestra.run.trial010.stdout:Reading state information... 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout: sg3-utils-udev 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout:The following additional packages will be installed: 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout: linux-generic linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T09:35:33.438 INFO:teuthology.orchestra.run.trial010.stdout: linux-headers-generic linux-image-5.15.0-170-generic 2026-02-13T09:35:33.439 INFO:teuthology.orchestra.run.trial010.stdout: linux-modules-5.15.0-170-generic linux-modules-extra-5.15.0-170-generic 2026-02-13T09:35:33.439 INFO:teuthology.orchestra.run.trial010.stdout:Suggested packages: 2026-02-13T09:35:33.439 INFO:teuthology.orchestra.run.trial010.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2026-02-13T09:35:33.451 INFO:teuthology.orchestra.run.trial010.stdout:The following NEW packages will be installed: 2026-02-13T09:35:33.452 INFO:teuthology.orchestra.run.trial010.stdout: linux-headers-5.15.0-170 linux-headers-5.15.0-170-generic 2026-02-13T09:35:33.452 INFO:teuthology.orchestra.run.trial010.stdout: linux-image-5.15.0-170-generic linux-modules-5.15.0-170-generic 2026-02-13T09:35:33.452 INFO:teuthology.orchestra.run.trial010.stdout: linux-modules-extra-5.15.0-170-generic 2026-02-13T09:35:33.452 INFO:teuthology.orchestra.run.trial010.stdout:The following packages will be upgraded: 2026-02-13T09:35:33.452 INFO:teuthology.orchestra.run.trial010.stdout: linux-generic linux-headers-generic linux-image-generic 2026-02-13T09:35:33.797 INFO:teuthology.orchestra.run.trial010.stdout:3 upgraded, 5 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T09:35:33.798 INFO:teuthology.orchestra.run.trial010.stdout:Need to get 113 MB of archives. 2026-02-13T09:35:33.798 INFO:teuthology.orchestra.run.trial010.stdout:After this operation, 585 MB of additional disk space will be used. 2026-02-13T09:35:33.798 INFO:teuthology.orchestra.run.trial010.stdout:Get:1 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-170-generic amd64 5.15.0-170.180 [22.7 MB] 2026-02-13T09:35:34.894 INFO:teuthology.orchestra.run.trial010.stdout:Get:2 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-170-generic amd64 5.15.0-170.180 [11.6 MB] 2026-02-13T09:35:35.165 INFO:teuthology.orchestra.run.trial010.stdout:Get:3 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-170-generic amd64 5.15.0-170.180 [64.0 MB] 2026-02-13T09:35:36.662 INFO:teuthology.orchestra.run.trial010.stdout:Get:4 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.170.159 [1654 B] 2026-02-13T09:35:36.662 INFO:teuthology.orchestra.run.trial010.stdout:Get:5 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.170.159 [2474 B] 2026-02-13T09:35:36.662 INFO:teuthology.orchestra.run.trial010.stdout:Get:6 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170 all 5.15.0-170.180 [12.4 MB] 2026-02-13T09:35:36.940 INFO:teuthology.orchestra.run.trial010.stdout:Get:7 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-170-generic amd64 5.15.0-170.180 [2828 kB] 2026-02-13T09:35:37.005 INFO:teuthology.orchestra.run.trial010.stdout:Get:8 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.170.159 [2316 B] 2026-02-13T09:35:37.205 INFO:teuthology.orchestra.run.trial010.stdout:Fetched 113 MB in 4s (31.9 MB/s) 2026-02-13T09:35:37.225 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package linux-modules-5.15.0-170-generic. 2026-02-13T09:35:37.390 INFO:teuthology.orchestra.run.trial010.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 131954 files and directories currently installed.) 2026-02-13T09:35:37.391 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../0-linux-modules-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T09:35:37.393 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:37.742 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package linux-image-5.15.0-170-generic. 2026-02-13T09:35:37.749 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../1-linux-image-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T09:35:37.767 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:37.806 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-170-generic. 2026-02-13T09:35:37.813 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T09:35:37.813 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:38.930 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../3-linux-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T09:35:38.931 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T09:35:38.954 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T09:35:38.955 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-image-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T09:35:38.971 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package linux-headers-5.15.0-170. 2026-02-13T09:35:38.979 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../5-linux-headers-5.15.0-170_5.15.0-170.180_all.deb ... 2026-02-13T09:35:38.979 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T09:35:40.316 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package linux-headers-5.15.0-170-generic. 2026-02-13T09:35:40.328 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../6-linux-headers-5.15.0-170-generic_5.15.0-170.180_amd64.deb ... 2026-02-13T09:35:40.328 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:40.906 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.170.159_amd64.deb ... 2026-02-13T09:35:40.907 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking linux-headers-generic (5.15.0.170.159) over (5.15.0.164.159) ... 2026-02-13T09:35:40.951 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-headers-5.15.0-170 (5.15.0-170.180) ... 2026-02-13T09:35:40.953 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-headers-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:40.954 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-headers-generic (5.15.0.170.159) ... 2026-02-13T09:35:40.955 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-modules-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:41.724 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:42.548 INFO:teuthology.orchestra.run.trial010.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.15.0-170-generic 2026-02-13T09:35:42.548 INFO:teuthology.orchestra.run.trial010.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.15.0-170-generic 2026-02-13T09:35:42.553 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-modules-extra-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:43.347 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-image-generic (5.15.0.170.159) ... 2026-02-13T09:35:43.348 INFO:teuthology.orchestra.run.trial010.stdout:Setting up linux-generic (5.15.0.170.159) ... 2026-02-13T09:35:43.349 INFO:teuthology.orchestra.run.trial010.stdout:Processing triggers for linux-image-5.15.0-170-generic (5.15.0-170.180) ... 2026-02-13T09:35:43.354 INFO:teuthology.orchestra.run.trial010.stdout:/etc/kernel/postinst.d/initramfs-tools: 2026-02-13T09:35:43.354 INFO:teuthology.orchestra.run.trial010.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-170-generic 2026-02-13T09:35:50.423 INFO:teuthology.orchestra.run.trial010.stdout:W: Possible missing firmware /lib/firmware/ast_dp501_fw.bin for module ast 2026-02-13T09:35:57.016 INFO:teuthology.orchestra.run.trial010.stdout:/etc/kernel/postinst.d/zz-update-grub: 2026-02-13T09:35:57.017 INFO:teuthology.orchestra.run.trial010.stdout:Sourcing file `/etc/default/grub' 2026-02-13T09:35:57.036 INFO:teuthology.orchestra.run.trial010.stdout:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T09:35:57.037 INFO:teuthology.orchestra.run.trial010.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T09:35:57.039 INFO:teuthology.orchestra.run.trial010.stdout:Generating grub configuration file ... 2026-02-13T09:35:57.122 INFO:teuthology.orchestra.run.trial010.stdout:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T09:35:57.129 INFO:teuthology.orchestra.run.trial010.stdout:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T09:35:57.304 INFO:teuthology.orchestra.run.trial010.stdout:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T09:35:57.309 INFO:teuthology.orchestra.run.trial010.stdout:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T09:35:57.382 INFO:teuthology.orchestra.run.trial010.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T09:35:57.382 INFO:teuthology.orchestra.run.trial010.stdout:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T09:35:57.383 INFO:teuthology.orchestra.run.trial010.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T09:35:57.385 INFO:teuthology.orchestra.run.trial010.stdout:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T09:35:57.394 INFO:teuthology.orchestra.run.trial010.stdout:done 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout:Pending kernel upgrade! 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout:Running kernel version: 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout: 5.15.0-164-generic 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout:Diagnostics: 2026-02-13T09:35:57.787 INFO:teuthology.orchestra.run.trial010.stdout: The currently running kernel version is not the expected kernel version 5.15.0-170-generic. 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout:Restarting the system to load the new kernel will not be handled automatically, so you should consider rebooting. [Return] 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout:The processor microcode seems to be up-to-date. 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout:No services need to be restarted. 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout:No containers need to be restarted. 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout:No user sessions are running outdated binaries. 2026-02-13T09:35:57.788 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:35:57.789 INFO:teuthology.orchestra.run.trial010.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T09:35:58.427 DEBUG:teuthology.orchestra.run.trial010:> dpkg -s linux-image-generic 2026-02-13T09:35:58.437 INFO:teuthology.orchestra.run.trial010.stdout:Package: linux-image-generic 2026-02-13T09:35:58.437 INFO:teuthology.orchestra.run.trial010.stdout:Status: install ok installed 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Priority: optional 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Section: kernel 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Installed-Size: 21 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Architecture: amd64 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Source: linux-meta 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Version: 5.15.0.170.159 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Recommends: thermald 2026-02-13T09:35:58.438 INFO:teuthology.orchestra.run.trial010.stdout:Description: Generic Linux kernel image 2026-02-13T09:35:58.439 INFO:teuthology.orchestra.run.trial010.stdout: This package will always depend on the latest generic kernel image 2026-02-13T09:35:58.439 INFO:teuthology.orchestra.run.trial010.stdout: available. 2026-02-13T09:35:58.439 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-164-generic Expected: 5.15.0-170-generic 2026-02-13T09:35:58.439 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-13T09:35:58.439 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-13T09:35:58.439 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-13T09:35:58.440 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial010.front.sepia.ceph.com, path=None, version=distro) 2026-02-13T09:35:58.440 DEBUG:teuthology.orchestra.run.trial010:> sudo apt-get clean 2026-02-13T09:35:58.518 DEBUG:teuthology.orchestra.run.trial010:> sudo apt-get update 2026-02-13T09:35:58.947 INFO:teuthology.orchestra.run.trial010.stdout:Hit:1 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T09:35:59.014 INFO:teuthology.orchestra.run.trial010.stdout:Hit:2 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T09:35:59.087 INFO:teuthology.orchestra.run.trial010.stdout:Hit:3 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T09:35:59.159 INFO:teuthology.orchestra.run.trial010.stdout:Hit:4 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T09:35:59.806 INFO:teuthology.orchestra.run.trial010.stdout:Reading package lists... 2026-02-13T09:35:59.821 DEBUG:teuthology.orchestra.run.trial010:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2026-02-13T09:35:59.855 INFO:teuthology.orchestra.run.trial010.stdout:Reading package lists... 2026-02-13T09:35:59.964 INFO:teuthology.orchestra.run.trial010.stdout:Building dependency tree... 2026-02-13T09:35:59.965 INFO:teuthology.orchestra.run.trial010.stdout:Reading state information... 2026-02-13T09:36:00.050 INFO:teuthology.orchestra.run.trial010.stdout:linux-image-generic is already the newest version (5.15.0.170.159). 2026-02-13T09:36:00.050 INFO:teuthology.orchestra.run.trial010.stdout:linux-image-generic set to manually installed. 2026-02-13T09:36:00.050 INFO:teuthology.orchestra.run.trial010.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T09:36:00.050 INFO:teuthology.orchestra.run.trial010.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T09:36:00.051 INFO:teuthology.orchestra.run.trial010.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T09:36:00.051 INFO:teuthology.orchestra.run.trial010.stdout: sg3-utils-udev 2026-02-13T09:36:00.051 INFO:teuthology.orchestra.run.trial010.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T09:36:00.070 INFO:teuthology.orchestra.run.trial010.stdout:0 upgraded, 0 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T09:36:00.072 DEBUG:teuthology.orchestra.run.trial010:> dpkg -s linux-image-generic 2026-02-13T09:36:00.123 INFO:teuthology.orchestra.run.trial010.stdout:Package: linux-image-generic 2026-02-13T09:36:00.123 INFO:teuthology.orchestra.run.trial010.stdout:Status: install ok installed 2026-02-13T09:36:00.123 INFO:teuthology.orchestra.run.trial010.stdout:Priority: optional 2026-02-13T09:36:00.123 INFO:teuthology.orchestra.run.trial010.stdout:Section: kernel 2026-02-13T09:36:00.123 INFO:teuthology.orchestra.run.trial010.stdout:Installed-Size: 21 2026-02-13T09:36:00.123 INFO:teuthology.orchestra.run.trial010.stdout:Maintainer: Ubuntu Kernel Team 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout:Architecture: amd64 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout:Source: linux-meta 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout:Version: 5.15.0.170.159 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.6), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-170), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.6) 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout:Depends: linux-image-5.15.0-170-generic, linux-modules-extra-5.15.0-170-generic, linux-firmware, intel-microcode, amd64-microcode 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout:Recommends: thermald 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout:Description: Generic Linux kernel image 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout: This package will always depend on the latest generic kernel image 2026-02-13T09:36:00.124 INFO:teuthology.orchestra.run.trial010.stdout: available. 2026-02-13T09:36:00.125 DEBUG:teuthology.orchestra.run.trial010:> mktemp 2026-02-13T09:36:00.169 INFO:teuthology.orchestra.run.trial010.stdout:/tmp/tmp.9dBPUxhYQv 2026-02-13T09:36:00.169 DEBUG:teuthology.orchestra.run.trial010:> sudo cp /boot/grub/grub.cfg /tmp/tmp.9dBPUxhYQv 2026-02-13T09:36:00.218 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod 0666 /tmp/tmp.9dBPUxhYQv 2026-02-13T09:36:00.315 DEBUG:teuthology.orchestra.remote:trial010:/tmp/tmp.9dBPUxhYQv is 7KB 2026-02-13T09:36:00.321 DEBUG:teuthology.orchestra.run.trial010:> rm -fr /tmp/tmp.9dBPUxhYQv 2026-02-13T09:36:00.324 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2026-02-13T09:36:00.377 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:36:00.377 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/etc/grub.d/01_ceph_kernel 2026-02-13T09:36:00.377 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2026-02-13T09:36:00.431 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-170-generic 2026-02-13T09:36:00.431 DEBUG:teuthology.orchestra.run.trial010:> sudo update-grub 2026-02-13T09:36:00.676 INFO:teuthology.orchestra.run.trial010.stderr:Sourcing file `/etc/default/grub' 2026-02-13T09:36:00.695 INFO:teuthology.orchestra.run.trial010.stderr:Sourcing file `/etc/default/grub.d/50-curtin-settings.cfg' 2026-02-13T09:36:00.696 INFO:teuthology.orchestra.run.trial010.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2026-02-13T09:36:00.698 INFO:teuthology.orchestra.run.trial010.stderr:Generating grub configuration file ... 2026-02-13T09:36:00.780 INFO:teuthology.orchestra.run.trial010.stderr:Found linux image: /boot/vmlinuz-5.15.0-170-generic 2026-02-13T09:36:00.786 INFO:teuthology.orchestra.run.trial010.stderr:Found initrd image: /boot/initrd.img-5.15.0-170-generic 2026-02-13T09:36:00.958 INFO:teuthology.orchestra.run.trial010.stderr:Found linux image: /boot/vmlinuz-5.15.0-164-generic 2026-02-13T09:36:00.963 INFO:teuthology.orchestra.run.trial010.stderr:Found initrd image: /boot/initrd.img-5.15.0-164-generic 2026-02-13T09:36:01.034 INFO:teuthology.orchestra.run.trial010.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2026-02-13T09:36:01.034 INFO:teuthology.orchestra.run.trial010.stderr:Systems on them will not be added to the GRUB boot configuration. 2026-02-13T09:36:01.034 INFO:teuthology.orchestra.run.trial010.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2026-02-13T09:36:01.036 INFO:teuthology.orchestra.run.trial010.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T09:36:01.043 INFO:teuthology.orchestra.run.trial010.stderr:done 2026-02-13T09:36:01.045 DEBUG:teuthology.orchestra.run.trial010:> sudo shutdown -r now 2026-02-13T09:36:31.078 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-13T09:36:31.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-13T09:36:31.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T09:36:45.341 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.10 2026-02-13T09:36:54.350 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-13T09:36:54.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T09:37:30.395 DEBUG:teuthology.orchestra.run.trial010:> true 2026-02-13T09:37:30.786 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-13T09:37:30.786 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-170-generic"... 2026-02-13T09:37:30.786 DEBUG:teuthology.orchestra.run.trial010:> uname -r 2026-02-13T09:37:30.833 INFO:teuthology.orchestra.run.trial010.stdout:5.15.0-170-generic 2026-02-13T09:37:30.834 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-170-generic vs 5.15.0-170-generic 2026-02-13T09:37:30.834 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T09:37:30.834 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2026-02-13T09:37:31.835 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-13T09:37:31.836 DEBUG:teuthology.orchestra.run.trial010:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-13T09:37:31.848 INFO:teuthology.orchestra.run.trial010.stdout:ttyS1 2026-02-13T09:37:31.863 DEBUG:teuthology.parallel:result is None 2026-02-13T09:37:31.863 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T09:37:31.874 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T09:37:31.874 DEBUG:teuthology.orchestra.run.trial010:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T09:37:31.909 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T09:37:31.919 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T09:37:31.933 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T09:37:31.933 DEBUG:teuthology.orchestra.run.trial010:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T09:37:31.959 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T09:37:31.969 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T09:37:31.970 DEBUG:teuthology.orchestra.run.trial010:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T09:37:32.006 INFO:teuthology.orchestra.run.trial010.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:37:32.012 INFO:teuthology.orchestra.run.trial010.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:37:32.013 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T09:37:32.023 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T09:37:32.023 DEBUG:teuthology.orchestra.run.trial010:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T09:37:32.062 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T09:37:32.078 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T09:37:32.078 DEBUG:teuthology.orchestra.run.trial010:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T09:37:32.109 DEBUG:teuthology.orchestra.run.trial010:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T09:37:32.153 DEBUG:teuthology.orchestra.run.trial010:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T09:37:32.197 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:37:32.197 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T09:37:32.245 DEBUG:teuthology.orchestra.run.trial010:> sudo service rsyslog restart 2026-02-13T09:37:32.303 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T09:37:32.316 INFO:teuthology.task.internal:Starting timer... 2026-02-13T09:37:32.316 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T09:37:32.338 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T09:37:32.350 DEBUG:teuthology.task.selinux:Excluding trial010: OS 'ubuntu' does not support SELinux 2026-02-13T09:37:32.350 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T09:37:32.350 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2026-02-13T09:37:32.350 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T09:37:32.350 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T09:37:32.362 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T09:37:32.368 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T09:37:32.369 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial010.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T09:38:29.963 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial010.front.sepia.ceph.com')] 2026-02-13T09:38:29.964 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-13T09:38:29.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial010.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T09:38:30.074 DEBUG:teuthology.orchestra.run.trial010:> true 2026-02-13T09:38:30.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial010.front.sepia.ceph.com' 2026-02-13T09:38:30.153 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T09:38:30.164 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T09:38:30.164 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T09:38:30.165 DEBUG:teuthology.orchestra.run.trial010:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T09:38:30.216 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2026-02-13T09:38:30.216 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Command line: ntpd -gq 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: ---------------------------------------------------- 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: ntp-4 is maintained by Network Time Foundation, 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: corporation. Support and training for ntp-4 are 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: available at https://www.nwtime.org/support 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: ---------------------------------------------------- 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: proto: precision = 0.030 usec (-25) 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: basedate set to 2022-02-04 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: gps base set to 2022-02-06 (week 2196) 2026-02-13T09:38:30.217 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T09:38:30.218 INFO:teuthology.orchestra.run.trial010.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2026-02-13T09:38:30.218 INFO:teuthology.orchestra.run.trial010.stderr:restrict ::: KOD does nothing without LIMITED. 2026-02-13T09:38:30.219 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: restrict ::: KOD does nothing without LIMITED. 2026-02-13T09:38:30.219 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Listen and drop on 0 v6wildcard [::]:123 2026-02-13T09:38:30.219 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2026-02-13T09:38:30.219 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Listen normally on 2 lo 127.0.0.1:123 2026-02-13T09:38:30.219 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Listen normally on 3 enp1s0f0 10.20.193.10:123 2026-02-13T09:38:30.219 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Listen normally on 4 lo [::1]:123 2026-02-13T09:38:30.219 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Listen normally on 5 enp1s0f0 [fe80::925a:8ff:fe77:5e60%2]:123 2026-02-13T09:38:30.220 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:29 ntpd[4896]: Listening on routing socket on fd #22 for interface updates 2026-02-13T09:38:31.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:30 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:31.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:30 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:31.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:30 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:31.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:30 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:31.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:30 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:31.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:30 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:32.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:32.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:32.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:32.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:32.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:32.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:32.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:32.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:32.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:32.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:32.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:32.248 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:31 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:33.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:32 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:33.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:32 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:33.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:32 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:33.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:32 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:33.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:32 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:33.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:32 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:34.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:34.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:34.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:34.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:34.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:34.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:34.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:34.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:34.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:34.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:34.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:34.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:34.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:34.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:34.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:34.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:34.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:34.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:33 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:35.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:34 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:35.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:34 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:35.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:34 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:35.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:34 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:35.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:34 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:35.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:34 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:36.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:36.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:36.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:36.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:36.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:36.217 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:36.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:36.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:36.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:36.219 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:36.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:36.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:36.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:36.239 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:36.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:36.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:36.247 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:36.248 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:35 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:37.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:36 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:37.216 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:36 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:37.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:36 ntpd[4896]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2026-02-13T09:38:37.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:36 ntpd[4896]: can't open /var/log/ntpstats/rawstats.20260213: Permission denied 2026-02-13T09:38:37.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:36 ntpd[4896]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2026-02-13T09:38:37.220 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:36 ntpd[4896]: can't open /var/log/ntpstats/peerstats.20260213: Permission denied 2026-02-13T09:38:37.220 INFO:teuthology.orchestra.run.trial010.stdout:13 Feb 09:38:37 ntpd[4896]: ntpd: time set +0.490213 s 2026-02-13T09:38:37.221 INFO:teuthology.orchestra.run.trial010.stdout:ntpd: time set +0.490213s 2026-02-13T09:38:37.221 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:37 ntpd[4896]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2026-02-13T09:38:37.221 INFO:teuthology.orchestra.run.trial010.stderr:13 Feb 09:38:37 ntpd[4896]: can't open /var/log/ntpstats/loopstats.20260213: Permission denied 2026-02-13T09:38:37.309 INFO:teuthology.orchestra.run.trial010.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T09:38:37.309 INFO:teuthology.orchestra.run.trial010.stdout:============================================================================== 2026-02-13T09:38:37.309 INFO:teuthology.orchestra.run.trial010.stdout: ntp1.glypnod.co .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T09:38:37.309 INFO:teuthology.orchestra.run.trial010.stdout: ntp.maxhost.io .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T09:38:37.309 INFO:teuthology.orchestra.run.trial010.stdout: 192-155-94-72.i .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T09:38:37.309 INFO:teuthology.orchestra.run.trial010.stdout: as393746.mci.tr .INIT. 16 u - 64 0 0.000 +0.000 0.000 2026-02-13T09:38:37.310 INFO:teuthology.run_tasks:Running task install... 2026-02-13T09:38:37.326 DEBUG:teuthology.task.install:project ceph 2026-02-13T09:38:37.326 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'}} 2026-02-13T09:38:37.326 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'} 2026-02-13T09:38:37.326 INFO:teuthology.task.install:Using flavor: default 2026-02-13T09:38:37.329 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T09:38:37.329 INFO:teuthology.task.install:extra packages: [] 2026-02-13T09:38:37.329 DEBUG:teuthology.orchestra.run.trial010:> sudo apt-key list | grep Ceph 2026-02-13T09:38:37.401 INFO:teuthology.orchestra.run.trial010.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2026-02-13T09:38:37.430 INFO:teuthology.orchestra.run.trial010.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2026-02-13T09:38:37.430 INFO:teuthology.orchestra.run.trial010.stdout:uid [ unknown] Ceph.com (release key) 2026-02-13T09:38:37.430 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2026-02-13T09:38:37.430 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T09:38:37.592 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default/ 2026-02-13T09:38:37.592 INFO:teuthology.task.install.deb:Package version is 20.2.0-636-g3b40640f-1jammy 2026-02-13T09:38:37.742 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:38:37.742 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2026-02-13T09:38:37.751 DEBUG:teuthology.orchestra.run.trial010:> sudo apt-get update 2026-02-13T09:38:37.921 INFO:teuthology.orchestra.run.trial010.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy InRelease 2026-02-13T09:38:37.933 INFO:teuthology.orchestra.run.trial010.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy Release [7680 B] 2026-02-13T09:38:37.944 INFO:teuthology.orchestra.run.trial010.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy Release.gpg 2026-02-13T09:38:37.955 INFO:teuthology.orchestra.run.trial010.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.8 kB] 2026-02-13T09:38:38.199 INFO:teuthology.orchestra.run.trial010.stdout:Hit:5 https://archive.ubuntu.com/ubuntu jammy InRelease 2026-02-13T09:38:38.269 INFO:teuthology.orchestra.run.trial010.stdout:Hit:6 https://archive.ubuntu.com/ubuntu jammy-updates InRelease 2026-02-13T09:38:38.340 INFO:teuthology.orchestra.run.trial010.stdout:Hit:7 https://archive.ubuntu.com/ubuntu jammy-security InRelease 2026-02-13T09:38:38.412 INFO:teuthology.orchestra.run.trial010.stdout:Hit:8 https://archive.ubuntu.com/ubuntu jammy-backports InRelease 2026-02-13T09:38:38.557 INFO:teuthology.orchestra.run.trial010.stdout:Fetched 26.5 kB in 1s (41.1 kB/s) 2026-02-13T09:38:39.064 INFO:teuthology.orchestra.run.trial010.stdout:Reading package lists... 2026-02-13T09:38:39.078 DEBUG:teuthology.orchestra.run.trial010:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=20.2.0-636-g3b40640f-1jammy cephadm=20.2.0-636-g3b40640f-1jammy ceph-mds=20.2.0-636-g3b40640f-1jammy ceph-mgr=20.2.0-636-g3b40640f-1jammy ceph-common=20.2.0-636-g3b40640f-1jammy ceph-fuse=20.2.0-636-g3b40640f-1jammy ceph-test=20.2.0-636-g3b40640f-1jammy ceph-volume=20.2.0-636-g3b40640f-1jammy radosgw=20.2.0-636-g3b40640f-1jammy python3-rados=20.2.0-636-g3b40640f-1jammy python3-rgw=20.2.0-636-g3b40640f-1jammy python3-cephfs=20.2.0-636-g3b40640f-1jammy python3-rbd=20.2.0-636-g3b40640f-1jammy libcephfs2=20.2.0-636-g3b40640f-1jammy libcephfs-dev=20.2.0-636-g3b40640f-1jammy librados2=20.2.0-636-g3b40640f-1jammy librbd1=20.2.0-636-g3b40640f-1jammy rbd-fuse=20.2.0-636-g3b40640f-1jammy 2026-02-13T09:38:39.111 INFO:teuthology.orchestra.run.trial010.stdout:Reading package lists... 2026-02-13T09:38:39.215 INFO:teuthology.orchestra.run.trial010.stdout:Building dependency tree... 2026-02-13T09:38:39.216 INFO:teuthology.orchestra.run.trial010.stdout:Reading state information... 2026-02-13T09:38:39.303 INFO:teuthology.orchestra.run.trial010.stdout:The following packages were automatically installed and are no longer required: 2026-02-13T09:38:39.303 INFO:teuthology.orchestra.run.trial010.stdout: kpartx libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 2026-02-13T09:38:39.303 INFO:teuthology.orchestra.run.trial010.stdout: libgfxdr0 libglusterfs0 libiscsi7 libpmemobj1 libsgutils2-2 sg3-utils 2026-02-13T09:38:39.303 INFO:teuthology.orchestra.run.trial010.stdout: sg3-utils-udev 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout:Use 'sudo apt autoremove' to remove them. 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout:The following additional packages will be installed: 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs-daemon libcephfs-proxy2 libdouble-conversion3 libfuse2 libjq1 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: liblttng-ust1 libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: libqt5dbus5 libqt5network5 libradosstriper1 librdkafka1 librgw2 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli python-asyncssh-doc 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: python3-asyncssh python3-cachetools python3-ceph-argparse 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: python3-ceph-common python3-cheroot python3-cherrypy3 python3-google-auth 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2026-02-13T09:38:39.304 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco.functools python3-jaraco.text python3-joblib 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python3-kubernetes python3-natsort python3-pluggy python3-portend 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python3-prettytable python3-psutil python3-py python3-pygments 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python3-pytest python3-repoze.lru python3-requests-oauthlib python3-routes 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python3-rsa python3-simplejson python3-sklearn python3-sklearn-lib 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python3-tempora python3-threadpoolctl python3-toml python3-wcwidth 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python3-webob python3-websocket python3-zc.lockfile qttranslations5-l10n 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: socat xmlstarlet 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout:Suggested packages: 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python3-influxdb liblua5.3-dev luarocks python-natsort-doc python-psutil-doc 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: subversion python-pygments-doc ttf-bitstream-vera python3-paste python3-dap 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout: python-sklearn-doc ipython3 python-webob-doc 2026-02-13T09:38:39.305 INFO:teuthology.orchestra.run.trial010.stdout:Recommended packages: 2026-02-13T09:38:39.306 INFO:teuthology.orchestra.run.trial010.stdout: btrfs-tools 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout:The following NEW packages will be installed: 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: libcephfs-daemon libcephfs-dev libcephfs-proxy2 libcephfs2 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: libdouble-conversion3 libfuse2 libjq1 liblttng-ust1 libnbd0 liboath0 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python3-asyncssh 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2026-02-13T09:38:39.338 INFO:teuthology.orchestra.run.trial010.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-iniconfig 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-jaraco.text python3-joblib python3-kubernetes python3-natsort 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-pygments python3-pytest python3-rados python3-rbd python3-repoze.lru 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-simplejson python3-sklearn python3-sklearn-lib python3-tempora 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-threadpoolctl python3-toml python3-wcwidth python3-webob 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: python3-websocket python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2026-02-13T09:38:39.339 INFO:teuthology.orchestra.run.trial010.stdout: socat xmlstarlet 2026-02-13T09:38:39.414 INFO:teuthology.orchestra.run.trial010.stdout:0 upgraded, 86 newly installed, 0 to remove and 38 not upgraded. 2026-02-13T09:38:39.414 INFO:teuthology.orchestra.run.trial010.stdout:Need to get 280 MB of archives. 2026-02-13T09:38:39.414 INFO:teuthology.orchestra.run.trial010.stdout:After this operation, 1119 MB of additional disk space will be used. 2026-02-13T09:38:39.415 INFO:teuthology.orchestra.run.trial010.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 20.2.0-636-g3b40640f-1jammy [3574 kB] 2026-02-13T09:38:39.515 INFO:teuthology.orchestra.run.trial010.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 20.2.0-636-g3b40640f-1jammy [2866 kB] 2026-02-13T09:38:39.554 INFO:teuthology.orchestra.run.trial010.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 20.2.0-636-g3b40640f-1jammy [833 kB] 2026-02-13T09:38:39.567 INFO:teuthology.orchestra.run.trial010.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 20.2.0-636-g3b40640f-1jammy [364 kB] 2026-02-13T09:38:39.573 INFO:teuthology.orchestra.run.trial010.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 20.2.0-636-g3b40640f-1jammy [32.8 kB] 2026-02-13T09:38:39.574 INFO:teuthology.orchestra.run.trial010.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 20.2.0-636-g3b40640f-1jammy [184 kB] 2026-02-13T09:38:39.577 INFO:teuthology.orchestra.run.trial010.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 20.2.0-636-g3b40640f-1jammy [83.9 kB] 2026-02-13T09:38:39.578 INFO:teuthology.orchestra.run.trial010.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 20.2.0-636-g3b40640f-1jammy [340 kB] 2026-02-13T09:38:39.583 INFO:teuthology.orchestra.run.trial010.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 20.2.0-636-g3b40640f-1jammy [8687 kB] 2026-02-13T09:38:39.687 INFO:teuthology.orchestra.run.trial010.stdout:Get:10 https://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2026-02-13T09:38:39.730 INFO:teuthology.orchestra.run.trial010.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 20.2.0-636-g3b40640f-1jammy [112 kB] 2026-02-13T09:38:39.731 INFO:teuthology.orchestra.run.trial010.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 20.2.0-636-g3b40640f-1jammy [261 kB] 2026-02-13T09:38:39.735 INFO:teuthology.orchestra.run.trial010.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 20.2.0-636-g3b40640f-1jammy [29.3 MB] 2026-02-13T09:38:40.025 INFO:teuthology.orchestra.run.trial010.stdout:Get:14 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2026-02-13T09:38:40.035 INFO:teuthology.orchestra.run.trial010.stdout:Get:15 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2026-02-13T09:38:40.105 INFO:teuthology.orchestra.run.trial010.stdout:Get:16 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2006 kB] 2026-02-13T09:38:40.228 INFO:teuthology.orchestra.run.trial010.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 20.2.0-636-g3b40640f-1jammy [5415 kB] 2026-02-13T09:38:40.306 INFO:teuthology.orchestra.run.trial010.stdout:Get:18 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2026-02-13T09:38:40.314 INFO:teuthology.orchestra.run.trial010.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 20.2.0-636-g3b40640f-1jammy [246 kB] 2026-02-13T09:38:40.316 INFO:teuthology.orchestra.run.trial010.stdout:Get:20 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2026-02-13T09:38:40.318 INFO:teuthology.orchestra.run.trial010.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 20.2.0-636-g3b40640f-1jammy [124 kB] 2026-02-13T09:38:40.320 INFO:teuthology.orchestra.run.trial010.stdout:Get:22 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 20.2.0-636-g3b40640f-1jammy [906 kB] 2026-02-13T09:38:40.335 INFO:teuthology.orchestra.run.trial010.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 20.2.0-636-g3b40640f-1jammy [6399 kB] 2026-02-13T09:38:40.342 INFO:teuthology.orchestra.run.trial010.stdout:Get:24 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2026-02-13T09:38:40.350 INFO:teuthology.orchestra.run.trial010.stdout:Get:25 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2026-02-13T09:38:40.352 INFO:teuthology.orchestra.run.trial010.stdout:Get:26 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2026-02-13T09:38:40.353 INFO:teuthology.orchestra.run.trial010.stdout:Get:27 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2026-02-13T09:38:40.354 INFO:teuthology.orchestra.run.trial010.stdout:Get:28 https://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2026-02-13T09:38:40.371 INFO:teuthology.orchestra.run.trial010.stdout:Get:29 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 liboath0 amd64 2.6.7-3ubuntu0.1 [41.3 kB] 2026-02-13T09:38:40.372 INFO:teuthology.orchestra.run.trial010.stdout:Get:30 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9030 B] 2026-02-13T09:38:40.378 INFO:teuthology.orchestra.run.trial010.stdout:Get:31 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2026-02-13T09:38:40.443 INFO:teuthology.orchestra.run.trial010.stdout:Get:32 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 20.2.0-636-g3b40640f-1jammy [21.7 MB] 2026-02-13T09:38:40.444 INFO:teuthology.orchestra.run.trial010.stdout:Get:33 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6452 B] 2026-02-13T09:38:40.444 INFO:teuthology.orchestra.run.trial010.stdout:Get:34 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8716 B] 2026-02-13T09:38:40.444 INFO:teuthology.orchestra.run.trial010.stdout:Get:35 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2026-02-13T09:38:40.445 INFO:teuthology.orchestra.run.trial010.stdout:Get:36 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2026-02-13T09:38:40.445 INFO:teuthology.orchestra.run.trial010.stdout:Get:37 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7240 B] 2026-02-13T09:38:40.445 INFO:teuthology.orchestra.run.trial010.stdout:Get:38 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8980 B] 2026-02-13T09:38:40.446 INFO:teuthology.orchestra.run.trial010.stdout:Get:39 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2026-02-13T09:38:40.450 INFO:teuthology.orchestra.run.trial010.stdout:Get:40 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2026-02-13T09:38:40.450 INFO:teuthology.orchestra.run.trial010.stdout:Get:41 https://archive.ubuntu.com/ubuntu jammy/universe amd64 libfuse2 amd64 2.9.9-5ubuntu3 [90.3 kB] 2026-02-13T09:38:40.520 INFO:teuthology.orchestra.run.trial010.stdout:Get:42 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python3-asyncssh all 2.5.0-1ubuntu0.1 [189 kB] 2026-02-13T09:38:40.522 INFO:teuthology.orchestra.run.trial010.stdout:Get:43 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2026-02-13T09:38:40.522 INFO:teuthology.orchestra.run.trial010.stdout:Get:44 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2026-02-13T09:38:40.523 INFO:teuthology.orchestra.run.trial010.stdout:Get:45 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2058 kB] 2026-02-13T09:38:40.548 INFO:teuthology.orchestra.run.trial010.stdout:Get:46 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2026-02-13T09:38:40.550 INFO:teuthology.orchestra.run.trial010.stdout:Get:47 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2026-02-13T09:38:40.550 INFO:teuthology.orchestra.run.trial010.stdout:Get:48 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1829 kB] 2026-02-13T09:38:40.608 INFO:teuthology.orchestra.run.trial010.stdout:Get:49 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9722 B] 2026-02-13T09:38:40.608 INFO:teuthology.orchestra.run.trial010.stdout:Get:50 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2026-02-13T09:38:40.609 INFO:teuthology.orchestra.run.trial010.stdout:Get:51 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2026-02-13T09:38:40.609 INFO:teuthology.orchestra.run.trial010.stdout:Get:52 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2026-02-13T09:38:40.609 INFO:teuthology.orchestra.run.trial010.stdout:Get:53 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2026-02-13T09:38:40.610 INFO:teuthology.orchestra.run.trial010.stdout:Get:54 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2026-02-13T09:38:40.667 INFO:teuthology.orchestra.run.trial010.stdout:Get:55 https://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2026-02-13T09:38:40.669 INFO:teuthology.orchestra.run.trial010.stdout:Get:56 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libjq1 amd64 1.6-2.1ubuntu3.1 [133 kB] 2026-02-13T09:38:40.670 INFO:teuthology.orchestra.run.trial010.stdout:Get:57 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 jq amd64 1.6-2.1ubuntu3.1 [52.5 kB] 2026-02-13T09:38:40.739 INFO:teuthology.orchestra.run.trial010.stdout:Get:58 https://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2026-02-13T09:38:40.742 INFO:teuthology.orchestra.run.trial010.stdout:Get:59 https://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2026-02-13T09:38:40.744 INFO:teuthology.orchestra.run.trial010.stdout:Get:60 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2026-02-13T09:38:40.748 INFO:teuthology.orchestra.run.trial010.stdout:Get:61 https://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 python-asyncssh-doc all 2.5.0-1ubuntu0.1 [309 kB] 2026-02-13T09:38:40.751 INFO:teuthology.orchestra.run.trial010.stdout:Get:62 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 2026-02-13T09:38:40.751 INFO:teuthology.orchestra.run.trial010.stdout:Get:63 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2026-02-13T09:38:40.751 INFO:teuthology.orchestra.run.trial010.stdout:Get:64 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2026-02-13T09:38:40.809 INFO:teuthology.orchestra.run.trial010.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 20.2.0-636-g3b40640f-1jammy [14.1 kB] 2026-02-13T09:38:40.809 INFO:teuthology.orchestra.run.trial010.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 20.2.0-636-g3b40640f-1jammy [957 kB] 2026-02-13T09:38:40.811 INFO:teuthology.orchestra.run.trial010.stdout:Get:67 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2026-02-13T09:38:40.812 INFO:teuthology.orchestra.run.trial010.stdout:Get:68 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-pygments all 2.11.2+dfsg-2ubuntu0.1 [750 kB] 2026-02-13T09:38:40.818 INFO:teuthology.orchestra.run.trial010.stdout:Get:69 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2026-02-13T09:38:40.821 INFO:teuthology.orchestra.run.trial010.stdout:Get:70 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 20.2.0-636-g3b40640f-1jammy [2345 kB] 2026-02-13T09:38:40.860 INFO:teuthology.orchestra.run.trial010.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 20.2.0-636-g3b40640f-1jammy [1049 kB] 2026-02-13T09:38:40.877 INFO:teuthology.orchestra.run.trial010.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 20.2.0-636-g3b40640f-1jammy [179 kB] 2026-02-13T09:38:40.881 INFO:teuthology.orchestra.run.trial010.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 20.2.0-636-g3b40640f-1jammy [45.5 MB] 2026-02-13T09:38:40.883 INFO:teuthology.orchestra.run.trial010.stdout:Get:74 https://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2026-02-13T09:38:40.885 INFO:teuthology.orchestra.run.trial010.stdout:Get:75 https://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2026-02-13T09:38:40.886 INFO:teuthology.orchestra.run.trial010.stdout:Get:76 https://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2026-02-13T09:38:40.887 INFO:teuthology.orchestra.run.trial010.stdout:Get:77 https://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1983 kB] 2026-02-13T09:38:41.648 INFO:teuthology.orchestra.run.trial010.stdout:Get:78 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 20.2.0-636-g3b40640f-1jammy [8625 kB] 2026-02-13T09:38:41.787 INFO:teuthology.orchestra.run.trial010.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 20.2.0-636-g3b40640f-1jammy [14.2 kB] 2026-02-13T09:38:41.787 INFO:teuthology.orchestra.run.trial010.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 20.2.0-636-g3b40640f-1jammy [99.4 MB] 2026-02-13T09:38:43.872 INFO:teuthology.orchestra.run.trial010.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 20.2.0-636-g3b40640f-1jammy [135 kB] 2026-02-13T09:38:43.872 INFO:teuthology.orchestra.run.trial010.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-daemon amd64 20.2.0-636-g3b40640f-1jammy [43.2 kB] 2026-02-13T09:38:43.873 INFO:teuthology.orchestra.run.trial010.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-proxy2 amd64 20.2.0-636-g3b40640f-1jammy [30.7 kB] 2026-02-13T09:38:43.873 INFO:teuthology.orchestra.run.trial010.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 20.2.0-636-g3b40640f-1jammy [41.5 kB] 2026-02-13T09:38:43.873 INFO:teuthology.orchestra.run.trial010.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 20.2.0-636-g3b40640f-1jammy [25.1 MB] 2026-02-13T09:38:44.444 INFO:teuthology.orchestra.run.trial010.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/wip-bharath17-testing-2026-02-12-0618-tentacle/3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 20.2.0-636-g3b40640f-1jammy [97.5 kB] 2026-02-13T09:38:44.727 INFO:teuthology.orchestra.run.trial010.stdout:Fetched 280 MB in 5s (54.8 MB/s) 2026-02-13T09:38:44.743 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2026-02-13T09:38:44.897 INFO:teuthology.orchestra.run.trial010.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 167438 files and directories currently installed.) 2026-02-13T09:38:44.899 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../00-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2026-02-13T09:38:44.900 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T09:38:44.919 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2026-02-13T09:38:44.932 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../01-libdouble-conversion3_3.1.7-4_amd64.deb ... 2026-02-13T09:38:44.932 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T09:38:44.948 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2026-02-13T09:38:44.960 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../02-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2026-02-13T09:38:44.960 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T09:38:44.980 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libqt5core5a:amd64. 2026-02-13T09:38:44.989 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../03-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T09:38:44.994 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T09:38:45.025 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2026-02-13T09:38:45.033 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../04-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T09:38:45.034 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T09:38:45.051 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libqt5network5:amd64. 2026-02-13T09:38:45.059 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../05-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2026-02-13T09:38:45.059 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T09:38:45.079 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2026-02-13T09:38:45.087 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../06-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2026-02-13T09:38:45.088 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T09:38:45.104 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package librados2. 2026-02-13T09:38:45.112 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../07-librados2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.112 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking librados2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.153 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libnbd0. 2026-02-13T09:38:45.161 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../08-libnbd0_1.10.5-1_amd64.deb ... 2026-02-13T09:38:45.162 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libnbd0 (1.10.5-1) ... 2026-02-13T09:38:45.176 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package librbd1. 2026-02-13T09:38:45.184 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../09-librbd1_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.184 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking librbd1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.221 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libcephfs2. 2026-02-13T09:38:45.229 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../10-libcephfs2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.230 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libcephfs2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.248 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-rados. 2026-02-13T09:38:45.256 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../11-python3-rados_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.257 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-rados (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.274 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-ceph-argparse. 2026-02-13T09:38:45.282 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../12-python3-ceph-argparse_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:45.283 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-ceph-argparse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.297 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-cephfs. 2026-02-13T09:38:45.305 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../13-python3-cephfs_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.305 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-cephfs (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.321 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-ceph-common. 2026-02-13T09:38:45.329 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../14-python3-ceph-common_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:45.330 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.348 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-wcwidth. 2026-02-13T09:38:45.356 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../15-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2026-02-13T09:38:45.356 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T09:38:45.372 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-prettytable. 2026-02-13T09:38:45.380 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../16-python3-prettytable_2.5.0-2_all.deb ... 2026-02-13T09:38:45.381 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2026-02-13T09:38:45.395 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-rbd. 2026-02-13T09:38:45.403 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../17-python3-rbd_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.404 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-rbd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.421 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package librdkafka1:amd64. 2026-02-13T09:38:45.429 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../18-librdkafka1_1.8.0-1build1_amd64.deb ... 2026-02-13T09:38:45.429 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T09:38:45.448 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package librgw2. 2026-02-13T09:38:45.456 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../19-librgw2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.456 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking librgw2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.551 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-rgw. 2026-02-13T09:38:45.560 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../20-python3-rgw_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.560 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-rgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.575 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package liboath0:amd64. 2026-02-13T09:38:45.583 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../21-liboath0_2.6.7-3ubuntu0.1_amd64.deb ... 2026-02-13T09:38:45.584 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T09:38:45.597 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libradosstriper1. 2026-02-13T09:38:45.606 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../22-libradosstriper1_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.606 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libradosstriper1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.623 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-common. 2026-02-13T09:38:45.631 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../23-ceph-common_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.632 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.876 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-base. 2026-02-13T09:38:45.884 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../24-ceph-base_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:45.889 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-base (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:45.953 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-jaraco.functools. 2026-02-13T09:38:45.961 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../25-python3-jaraco.functools_3.4.0-2_all.deb ... 2026-02-13T09:38:45.961 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2026-02-13T09:38:45.976 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-cheroot. 2026-02-13T09:38:45.984 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../26-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2026-02-13T09:38:45.984 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T09:38:46.001 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-jaraco.classes. 2026-02-13T09:38:46.009 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../27-python3-jaraco.classes_3.2.1-3_all.deb ... 2026-02-13T09:38:46.010 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2026-02-13T09:38:46.024 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-jaraco.text. 2026-02-13T09:38:46.032 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../28-python3-jaraco.text_3.6.0-2_all.deb ... 2026-02-13T09:38:46.033 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2026-02-13T09:38:46.047 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-jaraco.collections. 2026-02-13T09:38:46.055 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../29-python3-jaraco.collections_3.4.0-2_all.deb ... 2026-02-13T09:38:46.055 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2026-02-13T09:38:46.070 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-tempora. 2026-02-13T09:38:46.078 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../30-python3-tempora_4.1.2-1_all.deb ... 2026-02-13T09:38:46.078 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-tempora (4.1.2-1) ... 2026-02-13T09:38:46.092 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-portend. 2026-02-13T09:38:46.101 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../31-python3-portend_3.0.0-1_all.deb ... 2026-02-13T09:38:46.101 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-portend (3.0.0-1) ... 2026-02-13T09:38:46.115 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-zc.lockfile. 2026-02-13T09:38:46.123 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../32-python3-zc.lockfile_2.0-1_all.deb ... 2026-02-13T09:38:46.123 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2026-02-13T09:38:46.138 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-cherrypy3. 2026-02-13T09:38:46.147 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../33-python3-cherrypy3_18.6.1-4_all.deb ... 2026-02-13T09:38:46.147 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2026-02-13T09:38:46.170 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-natsort. 2026-02-13T09:38:46.178 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../34-python3-natsort_8.0.2-1_all.deb ... 2026-02-13T09:38:46.179 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-natsort (8.0.2-1) ... 2026-02-13T09:38:46.195 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2026-02-13T09:38:46.203 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../35-ceph-mgr-modules-core_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:46.204 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mgr-modules-core (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.230 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2026-02-13T09:38:46.239 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../36-libsqlite3-mod-ceph_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.239 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libsqlite3-mod-ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.254 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mgr. 2026-02-13T09:38:46.262 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../37-ceph-mgr_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.263 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mgr (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.282 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mon. 2026-02-13T09:38:46.291 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../38-ceph-mon_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.291 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.347 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libfuse2:amd64. 2026-02-13T09:38:46.355 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../39-libfuse2_2.9.9-5ubuntu3_amd64.deb ... 2026-02-13T09:38:46.355 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T09:38:46.371 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-osd. 2026-02-13T09:38:46.379 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../40-ceph-osd_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.380 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-osd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.523 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph. 2026-02-13T09:38:46.532 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../41-ceph_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.532 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.545 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-fuse. 2026-02-13T09:38:46.553 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../42-ceph-fuse_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.554 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.574 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mds. 2026-02-13T09:38:46.583 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../43-ceph-mds_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.583 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mds (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.614 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package cephadm. 2026-02-13T09:38:46.622 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../44-cephadm_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:46.622 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.638 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-asyncssh. 2026-02-13T09:38:46.647 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../45-python3-asyncssh_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T09:38:46.647 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T09:38:46.668 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2026-02-13T09:38:46.677 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../46-ceph-mgr-cephadm_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:46.677 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mgr-cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:46.697 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-repoze.lru. 2026-02-13T09:38:46.706 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../47-python3-repoze.lru_0.7-2_all.deb ... 2026-02-13T09:38:46.706 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2026-02-13T09:38:46.721 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-routes. 2026-02-13T09:38:46.729 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../48-python3-routes_2.5.1-1ubuntu1_all.deb ... 2026-02-13T09:38:46.730 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T09:38:46.749 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2026-02-13T09:38:46.757 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../49-ceph-mgr-dashboard_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:46.758 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mgr-dashboard (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:47.189 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2026-02-13T09:38:47.198 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../50-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2026-02-13T09:38:47.198 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T09:38:47.236 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-joblib. 2026-02-13T09:38:47.245 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../51-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2026-02-13T09:38:47.246 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T09:38:47.272 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-threadpoolctl. 2026-02-13T09:38:47.280 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../52-python3-threadpoolctl_3.1.0-1_all.deb ... 2026-02-13T09:38:47.281 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2026-02-13T09:38:47.295 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-sklearn. 2026-02-13T09:38:47.304 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../53-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2026-02-13T09:38:47.304 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T09:38:47.387 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2026-02-13T09:38:47.396 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../54-ceph-mgr-diskprediction-local_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:47.396 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mgr-diskprediction-local (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:47.560 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-cachetools. 2026-02-13T09:38:47.569 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../55-python3-cachetools_5.0.0-1_all.deb ... 2026-02-13T09:38:47.569 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2026-02-13T09:38:47.584 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-rsa. 2026-02-13T09:38:47.593 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../56-python3-rsa_4.8-1_all.deb ... 2026-02-13T09:38:47.593 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-rsa (4.8-1) ... 2026-02-13T09:38:47.610 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-google-auth. 2026-02-13T09:38:47.619 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../57-python3-google-auth_1.5.1-3_all.deb ... 2026-02-13T09:38:47.620 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2026-02-13T09:38:47.637 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-requests-oauthlib. 2026-02-13T09:38:47.645 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../58-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2026-02-13T09:38:47.646 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T09:38:47.662 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-websocket. 2026-02-13T09:38:47.670 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../59-python3-websocket_1.2.3-1_all.deb ... 2026-02-13T09:38:47.671 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-websocket (1.2.3-1) ... 2026-02-13T09:38:47.688 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-kubernetes. 2026-02-13T09:38:47.696 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../60-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2026-02-13T09:38:47.697 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T09:38:47.790 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2026-02-13T09:38:47.799 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../61-ceph-mgr-k8sevents_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:47.800 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-mgr-k8sevents (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:47.814 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libonig5:amd64. 2026-02-13T09:38:47.822 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../62-libonig5_6.9.7.1-2build1_amd64.deb ... 2026-02-13T09:38:47.823 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T09:38:47.838 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libjq1:amd64. 2026-02-13T09:38:47.847 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../63-libjq1_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T09:38:47.847 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T09:38:47.862 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package jq. 2026-02-13T09:38:47.871 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../64-jq_1.6-2.1ubuntu3.1_amd64.deb ... 2026-02-13T09:38:47.871 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking jq (1.6-2.1ubuntu3.1) ... 2026-02-13T09:38:47.885 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package socat. 2026-02-13T09:38:47.893 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../65-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2026-02-13T09:38:47.894 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2026-02-13T09:38:47.912 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package xmlstarlet. 2026-02-13T09:38:47.921 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../66-xmlstarlet_1.6.1-2.1_amd64.deb ... 2026-02-13T09:38:47.922 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2026-02-13T09:38:47.957 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-test. 2026-02-13T09:38:47.965 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../67-ceph-test_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:47.965 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-test (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:48.904 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package ceph-volume. 2026-02-13T09:38:48.913 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../68-ceph-volume_20.2.0-636-g3b40640f-1jammy_all.deb ... 2026-02-13T09:38:48.913 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking ceph-volume (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:48.935 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libcephfs-daemon. 2026-02-13T09:38:48.944 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../69-libcephfs-daemon_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:48.944 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libcephfs-daemon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:48.958 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libcephfs-proxy2. 2026-02-13T09:38:48.966 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../70-libcephfs-proxy2_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:48.967 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libcephfs-proxy2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:48.980 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package libcephfs-dev. 2026-02-13T09:38:48.989 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../71-libcephfs-dev_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:48.989 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking libcephfs-dev (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:49.004 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package nvme-cli. 2026-02-13T09:38:49.013 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../72-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2026-02-13T09:38:49.013 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T09:38:49.044 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python-asyncssh-doc. 2026-02-13T09:38:49.052 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../73-python-asyncssh-doc_2.5.0-1ubuntu0.1_all.deb ... 2026-02-13T09:38:49.053 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T09:38:49.082 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-iniconfig. 2026-02-13T09:38:49.090 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../74-python3-iniconfig_1.1.1-2_all.deb ... 2026-02-13T09:38:49.091 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2026-02-13T09:38:49.105 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-pluggy. 2026-02-13T09:38:49.113 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../75-python3-pluggy_0.13.0-7.1_all.deb ... 2026-02-13T09:38:49.114 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2026-02-13T09:38:49.129 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-psutil. 2026-02-13T09:38:49.137 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../76-python3-psutil_5.9.0-1build1_amd64.deb ... 2026-02-13T09:38:49.138 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2026-02-13T09:38:49.156 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-py. 2026-02-13T09:38:49.164 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../77-python3-py_1.10.0-1_all.deb ... 2026-02-13T09:38:49.165 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-py (1.10.0-1) ... 2026-02-13T09:38:49.185 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-pygments. 2026-02-13T09:38:49.193 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../78-python3-pygments_2.11.2+dfsg-2ubuntu0.1_all.deb ... 2026-02-13T09:38:49.193 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T09:38:49.234 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-toml. 2026-02-13T09:38:49.243 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../79-python3-toml_0.10.2-1_all.deb ... 2026-02-13T09:38:49.243 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-toml (0.10.2-1) ... 2026-02-13T09:38:49.258 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-pytest. 2026-02-13T09:38:49.266 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../80-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2026-02-13T09:38:49.266 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T09:38:49.288 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-simplejson. 2026-02-13T09:38:49.297 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../81-python3-simplejson_3.17.6-1build1_amd64.deb ... 2026-02-13T09:38:49.297 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2026-02-13T09:38:49.315 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package python3-webob. 2026-02-13T09:38:49.324 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../82-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2026-02-13T09:38:49.324 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T09:38:49.348 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package qttranslations5-l10n. 2026-02-13T09:38:49.356 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../83-qttranslations5-l10n_5.15.3-1_all.deb ... 2026-02-13T09:38:49.356 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2026-02-13T09:38:49.423 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package radosgw. 2026-02-13T09:38:49.432 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../84-radosgw_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:49.433 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking radosgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:49.642 INFO:teuthology.orchestra.run.trial010.stdout:Selecting previously unselected package rbd-fuse. 2026-02-13T09:38:49.650 INFO:teuthology.orchestra.run.trial010.stdout:Preparing to unpack .../85-rbd-fuse_20.2.0-636-g3b40640f-1jammy_amd64.deb ... 2026-02-13T09:38:49.651 INFO:teuthology.orchestra.run.trial010.stdout:Unpacking rbd-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:49.678 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2026-02-13T09:38:49.744 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2026-02-13T09:38:49.745 INFO:teuthology.orchestra.run.trial010.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2026-02-13T09:38:49.818 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T09:38:50.104 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service → /lib/systemd/system/nvmf-autoconnect.service. 2026-02-13T09:38:50.498 INFO:teuthology.orchestra.run.trial010.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2026-02-13T09:38:50.507 INFO:teuthology.orchestra.run.trial010.stdout:Setting up cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:50.552 INFO:teuthology.orchestra.run.trial010.stdout:Adding system user cephadm....done 2026-02-13T09:38:50.563 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2026-02-13T09:38:50.635 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python-asyncssh-doc (2.5.0-1ubuntu0.1) ... 2026-02-13T09:38:50.636 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2026-02-13T09:38:50.708 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-repoze.lru (0.7-2) ... 2026-02-13T09:38:50.783 INFO:teuthology.orchestra.run.trial010.stdout:Setting up liboath0:amd64 (2.6.7-3ubuntu0.1) ... 2026-02-13T09:38:50.784 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-py (1.10.0-1) ... 2026-02-13T09:38:50.880 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2026-02-13T09:38:51.004 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-cachetools (5.0.0-1) ... 2026-02-13T09:38:51.079 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2026-02-13T09:38:51.154 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-ceph-argparse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:51.222 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2026-02-13T09:38:51.223 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libnbd0 (1.10.5-1) ... 2026-02-13T09:38:51.224 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libfuse2:amd64 (2.9.9-5ubuntu3) ... 2026-02-13T09:38:51.225 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2026-02-13T09:38:51.226 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2026-02-13T09:38:51.351 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-natsort (8.0.2-1) ... 2026-02-13T09:38:51.429 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libcephfs-proxy2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:51.431 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2026-02-13T09:38:51.507 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2026-02-13T09:38:51.596 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-pygments (2.11.2+dfsg-2ubuntu0.1) ... 2026-02-13T09:38:51.850 INFO:teuthology.orchestra.run.trial010.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2026-02-13T09:38:51.851 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2026-02-13T09:38:51.947 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-asyncssh (2.5.0-1ubuntu0.1) ... 2026-02-13T09:38:52.074 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2026-02-13T09:38:52.156 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2026-02-13T09:38:52.228 INFO:teuthology.orchestra.run.trial010.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2026-02-13T09:38:52.229 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:52.317 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2026-02-13T09:38:52.828 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T09:38:52.833 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-toml (0.10.2-1) ... 2026-02-13T09:38:52.911 INFO:teuthology.orchestra.run.trial010.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2026-02-13T09:38:52.912 INFO:teuthology.orchestra.run.trial010.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2026-02-13T09:38:52.913 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2026-02-13T09:38:52.987 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2026-02-13T09:38:53.059 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T09:38:53.060 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-rsa (4.8-1) ... 2026-02-13T09:38:53.137 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-tempora (4.1.2-1) ... 2026-02-13T09:38:53.209 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-prettytable (2.5.0-2) ... 2026-02-13T09:38:53.286 INFO:teuthology.orchestra.run.trial010.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2026-02-13T09:38:53.287 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-websocket (1.2.3-1) ... 2026-02-13T09:38:53.371 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2026-02-13T09:38:53.372 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2026-02-13T09:38:53.448 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2026-02-13T09:38:53.532 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2026-02-13T09:38:53.608 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3.1) ... 2026-02-13T09:38:53.609 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2026-02-13T09:38:53.743 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-portend (3.0.0-1) ... 2026-02-13T09:38:53.816 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2026-02-13T09:38:53.817 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-google-auth (1.5.1-3) ... 2026-02-13T09:38:53.901 INFO:teuthology.orchestra.run.trial010.stdout:Setting up jq (1.6-2.1ubuntu3.1) ... 2026-02-13T09:38:53.902 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2026-02-13T09:38:54.035 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2026-02-13T09:38:54.036 INFO:teuthology.orchestra.run.trial010.stdout:Setting up librados2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.037 INFO:teuthology.orchestra.run.trial010.stdout:Setting up librgw2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.038 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libsqlite3-mod-ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.039 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2026-02-13T09:38:54.569 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libcephfs2 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.570 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libradosstriper1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.571 INFO:teuthology.orchestra.run.trial010.stdout:Setting up librbd1 (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.572 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mgr-modules-core (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.573 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:54.645 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T09:38:54.645 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target → /lib/systemd/system/ceph-fuse.target. 2026-02-13T09:38:55.066 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libcephfs-dev (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.067 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-rados (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.068 INFO:teuthology.orchestra.run.trial010.stdout:Setting up libcephfs-daemon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.069 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-rbd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.070 INFO:teuthology.orchestra.run.trial010.stdout:Setting up rbd-fuse (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.071 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-rgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.071 INFO:teuthology.orchestra.run.trial010.stdout:Setting up python3-cephfs (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.072 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-common (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.100 INFO:teuthology.orchestra.run.trial010.stdout:Adding group ceph....done 2026-02-13T09:38:55.135 INFO:teuthology.orchestra.run.trial010.stdout:Adding system user ceph....done 2026-02-13T09:38:55.145 INFO:teuthology.orchestra.run.trial010.stdout:Setting system user ceph properties....done 2026-02-13T09:38:55.152 INFO:teuthology.orchestra.run.trial010.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2026-02-13T09:38:55.239 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /lib/systemd/system/ceph.target. 2026-02-13T09:38:55.507 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service → /lib/systemd/system/rbdmap.service. 2026-02-13T09:38:55.906 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-test (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:55.907 INFO:teuthology.orchestra.run.trial010.stdout:Setting up radosgw (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:56.167 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T09:38:56.167 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /lib/systemd/system/ceph-radosgw.target. 2026-02-13T09:38:56.541 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-base (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:56.659 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /lib/systemd/system/ceph-crash.service. 2026-02-13T09:38:57.072 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mds (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:57.133 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T09:38:57.133 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /lib/systemd/system/ceph-mds.target. 2026-02-13T09:38:57.522 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mgr (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:57.599 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T09:38:57.599 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /lib/systemd/system/ceph-mgr.target. 2026-02-13T09:38:57.985 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-osd (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:58.082 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T09:38:58.082 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /lib/systemd/system/ceph-osd.target. 2026-02-13T09:38:58.496 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mgr-k8sevents (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:58.506 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mgr-diskprediction-local (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:58.517 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mon (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:58.585 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T09:38:58.586 INFO:teuthology.orchestra.run.trial010.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /lib/systemd/system/ceph-mon.target. 2026-02-13T09:38:58.992 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mgr-cephadm (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:59.002 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:59.003 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-mgr-dashboard (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:59.012 INFO:teuthology.orchestra.run.trial010.stdout:Setting up ceph-volume (20.2.0-636-g3b40640f-1jammy) ... 2026-02-13T09:38:59.122 INFO:teuthology.orchestra.run.trial010.stdout:Processing triggers for man-db (2.10.2-1) ... 2026-02-13T09:38:59.208 INFO:teuthology.orchestra.run.trial010.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.11) ... 2026-02-13T09:38:59.648 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout:Running kernel seems to be up-to-date. 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout:The processor microcode seems to be up-to-date. 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout:No services need to be restarted. 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout:No containers need to be restarted. 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout:No user sessions are running outdated binaries. 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout: 2026-02-13T09:38:59.649 INFO:teuthology.orchestra.run.trial010.stdout:No VM guests are running outdated hypervisor (qemu) binaries on this host. 2026-02-13T09:39:00.305 INFO:teuthology.orchestra.run.trial010.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2026-02-13T09:39:00.311 DEBUG:teuthology.parallel:result is None 2026-02-13T09:39:00.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T09:39:00.478 DEBUG:teuthology.orchestra.run.trial010:> dpkg-query -W -f '${Version}' ceph 2026-02-13T09:39:00.489 INFO:teuthology.orchestra.run.trial010.stdout:20.2.0-636-g3b40640f-1jammy 2026-02-13T09:39:00.490 INFO:teuthology.packaging:The installed version of ceph is 20.2.0-636-g3b40640f-1jammy 2026-02-13T09:39:00.490 INFO:teuthology.task.install:The correct ceph version 20.2.0-636-g3b40640f-1jammy is installed. 2026-02-13T09:39:00.492 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T09:39:00.493 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:39:00.493 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T09:39:00.539 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T09:39:00.539 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:39:00.539 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T09:39:00.591 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T09:39:00.638 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T09:39:00.639 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:39:00.639 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T09:39:00.686 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T09:39:00.734 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T09:39:00.734 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:39:00.735 DEBUG:teuthology.orchestra.run.trial010:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T09:39:00.782 DEBUG:teuthology.orchestra.run.trial010:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T09:39:00.830 INFO:teuthology.run_tasks:Running task workunit... 2026-02-13T09:39:00.861 INFO:tasks.workunit:Pulling workunits from ref 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T09:39:00.861 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-13T09:39:00.862 INFO:tasks.workunit:timeout=3h 2026-02-13T09:39:00.862 INFO:tasks.workunit:cleanup=True 2026-02-13T09:39:00.862 DEBUG:teuthology.orchestra.run.trial010:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-13T09:39:00.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T09:39:00.875 INFO:teuthology.orchestra.run.trial010.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-13T09:39:00.875 DEBUG:teuthology.orchestra.run.trial010:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-13T09:39:00.923 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-13T09:39:00.923 DEBUG:teuthology.orchestra.run.trial010:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-13T09:39:00.974 DEBUG:teuthology.orchestra.run.trial010:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb 2026-02-13T09:39:01.025 INFO:tasks.workunit.client.0.trial010.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr:Note: switching to '3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb'. 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr: 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr:state without impacting any branches by switching back to a branch. 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr: 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-13T09:39:22.867 INFO:tasks.workunit.client.0.trial010.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr: 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr: git switch -c 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr: 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr:Or undo this operation with: 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr: 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr: git switch - 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr: 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr: 2026-02-13T09:39:22.868 INFO:tasks.workunit.client.0.trial010.stderr:HEAD is now at 3b40640f18f Merge branch 'wip-74888-tentacle' of https://github.com/aainscow/ceph into wip-bharath17-testing-2026-02-12-0618-tentacle 2026-02-13T09:39:22.876 DEBUG:teuthology.orchestra.run.trial010:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/standalone && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-13T09:39:22.923 DEBUG:teuthology.orchestra.run.trial010:> set -ex 2026-02-13T09:39:22.923 DEBUG:teuthology.orchestra.run.trial010:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-13T09:39:22.970 INFO:tasks.workunit:Running workunits matching osd on client.0... 2026-02-13T09:39:22.970 INFO:tasks.workunit:Running workunit osd/bad-inc-map.sh... 2026-02-13T09:39:22.970 DEBUG:teuthology.orchestra.run.trial010:workunit test osd/bad-inc-map.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh 2026-02-13T09:39:23.021 INFO:tasks.workunit.client.0.trial010.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/bad-inc-map 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:8: run: local dir=td/bad-inc-map 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:9: run: shift 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: export CEPH_MON=127.0.0.1:51711 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:11: run: CEPH_MON=127.0.0.1:51711 2026-02-13T09:39:23.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:12: run: export CEPH_ARGS 2026-02-13T09:39:23.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: uuidgen 2026-02-13T09:39:23.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:13: run: CEPH_ARGS+='--fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none ' 2026-02-13T09:39:23.039 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:14: run: CEPH_ARGS+='--mon-host=127.0.0.1:51711 ' 2026-02-13T09:39:23.039 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:15: run: set -e 2026-02-13T09:39:23.039 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: set 2026-02-13T09:39:23.039 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:17: run: local funcs=TEST_bad_inc_map 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:18: run: for func in $funcs 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:19: run: setup td/bad-inc-map 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/bad-inc-map 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/bad-inc-map 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:39:23.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-13T09:39:23.042 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:39:23.042 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:39:23.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:39:23.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:39:23.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:39:23.044 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:39:23.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:39:23.045 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:39:23.046 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:39:23.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:39:23.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:39:23.047 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:39:23.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:23.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:39:23.049 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:39:23.049 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:23.050 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:39:23.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:39:23.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-13T09:39:23.053 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:39:23.053 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:23.053 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:23.053 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7491 2026-02-13T09:39:23.054 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:39:23.054 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:39:23.054 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/bad-inc-map 2026-02-13T09:39:23.056 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:39:23.056 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:23.056 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:23.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.7491 2026-02-13T09:39:23.058 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/bad-inc-map 1' TERM HUP INT 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:20: run: TEST_bad_inc_map td/bad-inc-map 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:26: TEST_bad_inc_map: local dir=td/bad-inc-map 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:28: TEST_bad_inc_map: run_mon td/bad-inc-map a 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/bad-inc-map 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/bad-inc-map/a 2026-02-13T09:39:23.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/bad-inc-map/a --run-dir=td/bad-inc-map 2026-02-13T09:39:23.095 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:39:23.096 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:23.096 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:23.096 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:23.096 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:23.096 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:23.096 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:23.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/bad-inc-map/a '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --mon-cluster-log-file=td/bad-inc-map/log --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:39:23.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:39:23.128 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:39:23.128 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:39:23.128 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:39:23.128 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:39:23.129 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:39:23.129 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:39:23.129 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:39:23.129 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:39:23.129 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:39:23.129 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:23.129 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:23.130 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7491/ceph-mon.a.asok 2026-02-13T09:39:23.130 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:39:23.130 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7491/ceph-mon.a.asok config get fsid 2026-02-13T09:39:23.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:39:23.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:39:23.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:39:23.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:23.186 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.7491/ceph-mon.a.asok 2026-02-13T09:39:23.187 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:39:23.187 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.7491/ceph-mon.a.asok config get mon_host 2026-02-13T09:39:23.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:29: TEST_bad_inc_map: run_mgr td/bad-inc-map x 2026-02-13T09:39:23.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/bad-inc-map 2026-02-13T09:39:23.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:39:23.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:39:23.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:39:23.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/bad-inc-map/x 2026-02-13T09:39:23.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:39:23.353 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:39:23.353 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:23.353 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:23.353 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:23.353 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:23.354 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:23.354 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:23.354 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:39:23.355 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/bad-inc-map/x '--log-file=td/bad-inc-map/$name.log' '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --run-dir=td/bad-inc-map '--pid-file=td/bad-inc-map/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:30: TEST_bad_inc_map: run_osd td/bad-inc-map 0 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/0 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 ' 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:39:23.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/0' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/0/journal' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:23.379 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:39:23.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:39:23.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:39:23.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:39:23.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/0 2026-02-13T09:39:23.381 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:39:23.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6d03119f-8b3d-4382-bb8d-9e9965e713ec 2026-02-13T09:39:23.382 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 6d03119f-8b3d-4382-bb8d-9e9965e713ec 2026-02-13T09:39:23.382 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 6d03119f-8b3d-4382-bb8d-9e9965e713ec' 2026-02-13T09:39:23.382 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:39:23.389 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBL8Y5pS+4GFxAARglgvl+yhljnGi0hKAWVbg== 2026-02-13T09:39:23.389 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBL8Y5pS+4GFxAARglgvl+yhljnGi0hKAWVbg=="}' 2026-02-13T09:39:23.389 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6d03119f-8b3d-4382-bb8d-9e9965e713ec -i td/bad-inc-map/0/new.json 2026-02-13T09:39:23.510 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:23.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/0/new.json 2026-02-13T09:39:23.518 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBL8Y5pS+4GFxAARglgvl+yhljnGi0hKAWVbg== --osd-uuid 6d03119f-8b3d-4382-bb8d-9e9965e713ec 2026-02-13T09:39:23.533 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:23.529+0000 7f7074930a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:23.534 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:23.529+0000 7f7074930a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:23.535 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:23.529+0000 7f7074930a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:23.535 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:23.529+0000 7f7074930a40 -1 bdev(0x562b39070c00 td/bad-inc-map/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:39:23.535 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:23.533+0000 7f7074930a40 -1 bluestore(td/bad-inc-map/0) _read_fsid unparsable uuid 2026-02-13T09:39:24.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/0/keyring 2026-02-13T09:39:24.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:39:24.157 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:39:24.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:39:24.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:39:24.271 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:39:24.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:39:24.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/0 --osd-journal=td/bad-inc-map/0/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:39:24.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:39:24.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:39:24.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:39:24.285 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:24.281+0000 7f6a07912a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:24.287 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:24.281+0000 7f6a07912a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:24.288 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:24.285+0000 7f6a07912a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:24.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:39:24.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:24.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:39:24.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:24.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:24.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:24.387 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:24.387 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:24.387 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:24.388 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:39:24.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:24.797 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:24.792+0000 7f6a07912a40 -1 Falling back to public interface 2026-02-13T09:39:25.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:25.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:25.494 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:25.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:39:25.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:25.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:39:25.600 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:25.870 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:25.864+0000 7f6a07912a40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:39:26.602 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:26.603 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:26.603 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:39:26.604 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:39:26.605 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:26.605 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1451030818,v1:127.0.0.1:6801/1451030818] [v2:127.0.0.1:6802/1451030818,v1:127.0.0.1:6803/1451030818] exists,up 6d03119f-8b3d-4382-bb8d-9e9965e713ec 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:31: TEST_bad_inc_map: run_osd td/bad-inc-map 1 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:39:26.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/1 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 ' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/1' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/1/journal' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:26.807 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:39:26.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/1 2026-02-13T09:39:26.809 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:39:26.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=090fe635-19e1-481c-ace4-5142642e7026 2026-02-13T09:39:26.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 090fe635-19e1-481c-ace4-5142642e7026' 2026-02-13T09:39:26.810 INFO:tasks.workunit.client.0.trial010.stdout:add osd1 090fe635-19e1-481c-ace4-5142642e7026 2026-02-13T09:39:26.811 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:39:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBO8Y5p/ZPYMBAAVWzIXORFLUr7OXgvg3uM4w== 2026-02-13T09:39:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBO8Y5p/ZPYMBAAVWzIXORFLUr7OXgvg3uM4w=="}' 2026-02-13T09:39:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 090fe635-19e1-481c-ace4-5142642e7026 -i td/bad-inc-map/1/new.json 2026-02-13T09:39:27.034 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:27.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/1/new.json 2026-02-13T09:39:27.043 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBO8Y5p/ZPYMBAAVWzIXORFLUr7OXgvg3uM4w== --osd-uuid 090fe635-19e1-481c-ace4-5142642e7026 2026-02-13T09:39:27.059 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:27.052+0000 7f6810c03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:27.060 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:27.056+0000 7f6810c03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:27.061 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:27.056+0000 7f6810c03a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:27.062 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:27.056+0000 7f6810c03a40 -1 bdev(0x5640f7450c00 td/bad-inc-map/1/block) open stat got: (1) Operation not permitted 2026-02-13T09:39:27.062 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:27.056+0000 7f6810c03a40 -1 bluestore(td/bad-inc-map/1) _read_fsid unparsable uuid 2026-02-13T09:39:27.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/1/keyring 2026-02-13T09:39:27.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:39:27.734 INFO:tasks.workunit.client.0.trial010.stdout:adding osd1 key to auth repository 2026-02-13T09:39:27.734 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T09:39:27.734 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:39:28.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T09:39:28.020 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:39:28.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/1 --osd-journal=td/bad-inc-map/1/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:39:28.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:39:28.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:39:28.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:39:28.043 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:28.036+0000 7f8597cf8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:28.045 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:28.040+0000 7f8597cf8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:28.046 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:28.040+0000 7f8597cf8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:28.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T09:39:28.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:28.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:39:28.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:28.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:28.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:28.231 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:28.231 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:28.231 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:28.232 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:39:28.417 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:28.412+0000 7f8597cf8a40 -1 Falling back to public interface 2026-02-13T09:39:28.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:29.034 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:29.028+0000 7f8597cf8a40 -1 osd.1 0 log_to_monitors true 2026-02-13T09:39:29.437 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:29.437 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:29.437 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:29.438 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:39:29.438 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:29.438 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:39:29.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:30.652 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:30.652 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:30.653 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:39:30.653 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:39:30.653 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:30.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:39:30.861 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/89028209,v1:127.0.0.1:6811/89028209] [v2:127.0.0.1:6812/89028209,v1:127.0.0.1:6813/89028209] exists,up 090fe635-19e1-481c-ace4-5142642e7026 2026-02-13T09:39:30.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:30.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:30.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:32: TEST_bad_inc_map: run_osd td/bad-inc-map 2 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/bad-inc-map 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/bad-inc-map/2 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 ' 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/bad-inc-map/2' 2026-02-13T09:39:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/bad-inc-map/2/journal' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/bad-inc-map' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:39:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/bad-inc-map/$name.log' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/bad-inc-map/$name.pid' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:39:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/bad-inc-map/2 2026-02-13T09:39:30.868 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:39:30.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=6cd8a5bf-b78c-47aa-bc30-fa450ed711aa 2026-02-13T09:39:30.868 INFO:tasks.workunit.client.0.trial010.stdout:add osd2 6cd8a5bf-b78c-47aa-bc30-fa450ed711aa 2026-02-13T09:39:30.869 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 6cd8a5bf-b78c-47aa-bc30-fa450ed711aa' 2026-02-13T09:39:30.869 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:39:30.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBS8Y5pdWUoNBAAcRt1weNydkXRjfitt2ELMw== 2026-02-13T09:39:30.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBS8Y5pdWUoNBAAcRt1weNydkXRjfitt2ELMw=="}' 2026-02-13T09:39:30.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 6cd8a5bf-b78c-47aa-bc30-fa450ed711aa -i td/bad-inc-map/2/new.json 2026-02-13T09:39:31.094 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:39:31.103 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/bad-inc-map/2/new.json 2026-02-13T09:39:31.103 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBS8Y5pdWUoNBAAcRt1weNydkXRjfitt2ELMw== --osd-uuid 6cd8a5bf-b78c-47aa-bc30-fa450ed711aa 2026-02-13T09:39:31.119 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:31.112+0000 7f6be5968a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:31.120 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:31.116+0000 7f6be5968a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:31.121 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:31.116+0000 7f6be5968a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:31.122 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:31.116+0000 7f6be5968a40 -1 bdev(0x55e51b0acc00 td/bad-inc-map/2/block) open stat got: (1) Operation not permitted 2026-02-13T09:39:31.122 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:31.116+0000 7f6be5968a40 -1 bluestore(td/bad-inc-map/2) _read_fsid unparsable uuid 2026-02-13T09:39:31.762 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/bad-inc-map/2/keyring 2026-02-13T09:39:31.762 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:39:31.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T09:39:31.764 INFO:tasks.workunit.client.0.trial010.stdout:adding osd2 key to auth repository 2026-02-13T09:39:31.764 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/bad-inc-map/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:39:32.054 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:39:32.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T09:39:32.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6270fe74-cd6d-432c-af8f-854f77b65139 --auth-supported=none --mon-host=127.0.0.1:51711 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/bad-inc-map/2 --osd-journal=td/bad-inc-map/2/journal --chdir= --run-dir=td/bad-inc-map '--admin-socket=/tmp/ceph-asok.7491/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/bad-inc-map/$name.log' '--pid-file=td/bad-inc-map/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:39:32.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:39:32.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:39:32.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:39:32.077 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:32.072+0000 7f6824677a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:32.078 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:32.072+0000 7f6824677a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:32.079 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:32.072+0000 7f6824677a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:32.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T09:39:32.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:32.269 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:39:32.269 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:32.269 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:32.269 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:32.269 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:32.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:32.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:32.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:39:32.429 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:32.424+0000 7f6824677a40 -1 Falling back to public interface 2026-02-13T09:39:32.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:33.043 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:33.036+0000 7f6824677a40 -1 osd.2 0 log_to_monitors true 2026-02-13T09:39:33.477 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:33.477 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:33.477 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:39:33.478 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:33.478 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:33.478 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:39:33.696 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/45002931,v1:127.0.0.1:6819/45002931] [v2:127.0.0.1:6820/45002931,v1:127.0.0.1:6821/45002931] exists,up 6cd8a5bf-b78c-47aa-bc30-fa450ed711aa 2026-02-13T09:39:33.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:33.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:33.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:33.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:34: TEST_bad_inc_map: ceph config set osd.2 osd_inject_bad_map_crc_probability 1 2026-02-13T09:39:33.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:37: TEST_bad_inc_map: create_pool foo 8 2026-02-13T09:39:33.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 8 2026-02-13T09:39:34.201 INFO:tasks.workunit.client.0.trial010.stderr:pool 'foo' already exists 2026-02-13T09:39:34.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:39:35.213 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:38: TEST_bad_inc_map: ceph osd pool set foo min_size 1 2026-02-13T09:39:35.519 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 min_size to 1 2026-02-13T09:39:35.534 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:39: TEST_bad_inc_map: ceph osd pool set foo min_size 2 2026-02-13T09:39:35.826 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 min_size to 2 2026-02-13T09:39:35.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:41: TEST_bad_inc_map: sleep 5 2026-02-13T09:39:40.841 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: TIMEOUT=10 2026-02-13T09:39:40.841 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:44: TEST_bad_inc_map: wait_for_osd up 0 2026-02-13T09:39:40.842 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:40.842 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:39:40.842 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:40.842 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:40.842 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-13T09:39:40.842 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:40.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:40.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:40.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:39:41.045 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/1451030818,v1:127.0.0.1:6801/1451030818] [v2:127.0.0.1:6802/1451030818,v1:127.0.0.1:6803/1451030818] exists,up 6d03119f-8b3d-4382-bb8d-9e9965e713ec 2026-02-13T09:39:41.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: TIMEOUT=10 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:45: TEST_bad_inc_map: wait_for_osd up 1 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-13T09:39:41.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:41.048 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:41.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:41.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:39:41.251 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/89028209,v1:127.0.0.1:6811/89028209] [v2:127.0.0.1:6812/89028209,v1:127.0.0.1:6813/89028209] exists,up 090fe635-19e1-481c-ace4-5142642e7026 2026-02-13T09:39:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: TIMEOUT=10 2026-02-13T09:39:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:46: TEST_bad_inc_map: wait_for_osd up 2 2026-02-13T09:39:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:39:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 10 )) 2026-02-13T09:39:41.253 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:41.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:41.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:41.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:39:41.457 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/45002931,v1:127.0.0.1:6819/45002931] [v2:127.0.0.1:6820/45002931,v1:127.0.0.1:6821/45002931] exists,up 6cd8a5bf-b78c-47aa-bc30-fa450ed711aa 2026-02-13T09:39:41.458 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:41.458 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:41.458 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:41.458 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:49: TEST_bad_inc_map: grep 'injecting map crc failure' td/bad-inc-map/osd.2.log 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:34.148+0000 7f68114af640 -1 osd.2 13 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:34.244+0000 7f68134b3640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:34.248+0000 7f68134b3640 -1 osd.2 14 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.332+0000 7f68114af640 -1 osd.2 15 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.412+0000 7f68134b3640 -1 osd.2 16 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.516+0000 7f68134b3640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.516+0000 7f68114af640 -1 osd.2 17 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.720+0000 7f68134b3640 -1 osd.2 18 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.459 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.820+0000 7f68134b3640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.460 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.820+0000 7f68114af640 -1 osd.2 19 handle_osd_map injecting map crc failure 2026-02-13T09:39:41.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:50: TEST_bad_inc_map: grep 'bailing because last' td/bad-inc-map/osd.2.log 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:34.148+0000 7f68114af640 10 osd.2 13 handle_osd_map bailing because last < start (13<14) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:34.248+0000 7f68134b3640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:34.248+0000 7f68134b3640 10 osd.2 14 handle_osd_map bailing because last < start (14<15) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.332+0000 7f68114af640 10 osd.2 15 handle_osd_map bailing because last < start (15<16) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.412+0000 7f68134b3640 10 osd.2 16 handle_osd_map bailing because last < start (16<17) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.516+0000 7f68134b3640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.516+0000 7f68114af640 10 osd.2 17 handle_osd_map bailing because last < start (17<18) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.720+0000 7f68134b3640 10 osd.2 18 handle_osd_map bailing because last < start (18<19) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.820+0000 7f68134b3640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-13T09:39:41.461 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:39:35.820+0000 7f68114af640 10 osd.2 19 handle_osd_map bailing because last < start (19<20) 2026-02-13T09:39:41.462 INFO:tasks.workunit.client.0.trial010.stdout:success 2026-02-13T09:39:41.462 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:52: TEST_bad_inc_map: echo success 2026-02-13T09:39:41.462 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:54: TEST_bad_inc_map: delete_pool foo 2026-02-13T09:39:41.462 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=foo 2026-02-13T09:39:41.462 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete foo foo --yes-i-really-really-mean-it 2026-02-13T09:39:41.696 INFO:tasks.workunit.client.0.trial010.stderr:pool 'foo' does not exist 2026-02-13T09:39:41.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:55: TEST_bad_inc_map: kill_daemons td/bad-inc-map 2026-02-13T09:39:41.706 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:39:41.706 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:39:41.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:39:41.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:39:41.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:39:47.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:39:47.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/bad-inc-map.sh:21: run: teardown td/bad-inc-map 2026-02-13T09:39:47.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-13T09:39:47.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:39:47.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-13T09:39:47.023 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:39:47.024 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:39:47.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:39:47.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:39:47.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:39:47.029 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:39:47.029 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:39:47.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:39:47.030 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:39:47.031 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:39:47.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:39:47.032 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:39:47.033 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:47.033 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:39:47.034 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:39:47.034 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:47.034 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:39:47.036 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:39:47.036 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-13T09:39:47.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:39:47.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:47.044 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7491 2026-02-13T09:39:47.045 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:39:47.045 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/bad-inc-map 0 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/bad-inc-map 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/bad-inc-map KILL 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:39:47.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:39:47.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:39:47.049 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:39:47.049 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:39:47.050 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:39:47.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:39:47.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:39:47.051 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:39:47.052 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:47.052 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:39:47.053 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:39:47.053 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:47.054 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:39:47.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T09:39:47.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/bad-inc-map 2026-02-13T09:39:47.057 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:39:47.057 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.057 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.7491 2026-02-13T09:39:47.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.7491 2026-02-13T09:39:47.058 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:39:47.058 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:39:47.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-13T09:39:47.060 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T09:39:47.060 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T09:39:47.116 INFO:tasks.workunit:Running workunit osd/divergent-priors.sh... 2026-02-13T09:39:47.117 DEBUG:teuthology.orchestra.run.trial010:workunit test osd/divergent-priors.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh 2026-02-13T09:39:47.168 INFO:tasks.workunit.client.0.trial010.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T09:39:47.174 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/divergent-priors 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:21: run: local dir=td/divergent-priors 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:22: run: shift 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: export loglen=12 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:25: run: loglen=12 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: export divisor=3 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:26: run: divisor=3 2026-02-13T09:39:47.175 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: expr 12 / 2 2026-02-13T09:39:47.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: export trim=6 2026-02-13T09:39:47.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:27: run: trim=6 2026-02-13T09:39:47.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: expr 6 / 3 2026-02-13T09:39:47.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: export DIVERGENT_WRITE=2 2026-02-13T09:39:47.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:28: run: DIVERGENT_WRITE=2 2026-02-13T09:39:47.177 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: expr 6 / 3 2026-02-13T09:39:47.178 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: export DIVERGENT_REMOVE=2 2026-02-13T09:39:47.178 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:29: run: DIVERGENT_REMOVE=2 2026-02-13T09:39:47.178 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: expr 6 / 3 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: export DIVERGENT_CREATE=2 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:30: run: DIVERGENT_CREATE=2 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: export poolname=test 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:31: run: poolname=test 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: export testobjects=100 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:32: run: testobjects=100 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: export CEPH_MON=127.0.0.1:7115 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:34: run: CEPH_MON=127.0.0.1:7115 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:35: run: export CEPH_ARGS 2026-02-13T09:39:47.180 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: uuidgen 2026-02-13T09:39:47.181 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:36: run: CEPH_ARGS+='--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none ' 2026-02-13T09:39:47.181 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:37: run: CEPH_ARGS+='--mon-host=127.0.0.1:7115 ' 2026-02-13T09:39:47.182 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:39: run: CEPH_ARGS+='--osd_force_auth_primary_missing_objects=1000000 ' 2026-02-13T09:39:47.182 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:40: run: CEPH_ARGS+='--osd_debug_pg_log_writeout=true ' 2026-02-13T09:39:47.182 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:41: run: CEPH_ARGS+='--osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:39:47.182 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: set 2026-02-13T09:39:47.182 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T09:39:47.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:43: run: local 'funcs=TEST_divergent 2026-02-13T09:39:47.185 INFO:tasks.workunit.client.0.trial010.stderr:TEST_divergent_2 2026-02-13T09:39:47.185 INFO:tasks.workunit.client.0.trial010.stderr:TEST_divergent_3 2026-02-13T09:39:47.185 INFO:tasks.workunit.client.0.trial010.stderr:TEST_divergent_ec' 2026-02-13T09:39:47.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T09:39:47.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T09:39:47.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:39:47.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:39:47.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:39:47.187 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:39:47.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:39:47.188 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:39:47.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:39:47.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:39:47.190 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:39:47.191 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:47.191 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:39:47.192 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:39:47.192 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:39:47.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:39:47.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:39:47.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:39:47.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:39:47.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:47.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:39:47.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:39:47.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:39:47.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T09:39:47.199 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:39:47.199 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.199 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:47.199 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16079 2026-02-13T09:39:47.200 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:39:47.201 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent td/divergent-priors 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:57: TEST_divergent: local dir=td/divergent-priors 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: file_with_random_data 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-13T09:39:47.202 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-13T09:39:47.203 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.6Ydy6sgllw 2026-02-13T09:39:47.203 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.6Ydy6sgllw bs=512 count=1 2026-02-13T09:39:47.204 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:39:47.204 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:39:47.204 INFO:tasks.workunit.client.0.trial010.stderr:512 bytes copied, 9.3112e-05 s, 5.5 MB/s 2026-02-13T09:39:47.204 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.6Ydy6sgllw 2026-02-13T09:39:47.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:59: TEST_divergent: local dummyfile=/tmp/tmp.6Ydy6sgllw 2026-02-13T09:39:47.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:60: TEST_divergent: local num_osds=3 2026-02-13T09:39:47.205 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: expr 3 - 1 2026-02-13T09:39:47.206 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: seq 0 2 2026-02-13T09:39:47.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:61: TEST_divergent: local 'osds=0 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:62: TEST_divergent: run_mon td/divergent-priors a 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T09:39:47.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T09:39:47.236 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:39:47.237 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:47.237 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:47.237 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:47.237 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.237 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:47.237 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:47.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:39:47.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:39:47.269 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:39:47.270 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:39:47.270 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:39:47.270 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:39:47.270 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:39:47.271 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:39:47.271 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:39:47.271 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:39:47.271 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:39:47.271 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.272 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:47.272 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:39:47.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:39:47.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get fsid 2026-02-13T09:39:47.327 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:39:47.328 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:39:47.328 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:39:47.328 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:39:47.328 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:39:47.329 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:39:47.329 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:39:47.329 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:39:47.330 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:39:47.330 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.330 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:47.330 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:39:47.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:39:47.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get mon_host 2026-02-13T09:39:47.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:63: TEST_divergent: run_mgr td/divergent-priors x 2026-02-13T09:39:47.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T09:39:47.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:39:47.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:39:47.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:39:47.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T09:39:47.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:39:47.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:39:47.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:47.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:47.499 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:47.499 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.499 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:47.500 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:47.500 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:39:47.500 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:39:47.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 0 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:39:47.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:47.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:39:47.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:39:47.526 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:39:47.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=aec6e6ff-657c-40df-909b-9ffeba987f2c 2026-02-13T09:39:47.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 aec6e6ff-657c-40df-909b-9ffeba987f2c' 2026-02-13T09:39:47.527 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 aec6e6ff-657c-40df-909b-9ffeba987f2c 2026-02-13T09:39:47.527 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:39:47.538 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBj8Y5pXvfnHxAA/mfn2xkHQq+3u9mVYG7MMg== 2026-02-13T09:39:47.538 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBj8Y5pXvfnHxAA/mfn2xkHQq+3u9mVYG7MMg=="}' 2026-02-13T09:39:47.539 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new aec6e6ff-657c-40df-909b-9ffeba987f2c -i td/divergent-priors/0/new.json 2026-02-13T09:39:47.653 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:47.660 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T09:39:47.661 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBj8Y5pXvfnHxAA/mfn2xkHQq+3u9mVYG7MMg== --osd-uuid aec6e6ff-657c-40df-909b-9ffeba987f2c 2026-02-13T09:39:47.680 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:47.676+0000 7fda88f65a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:47.682 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:47.676+0000 7fda88f65a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:47.683 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:47.676+0000 7fda88f65a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:47.683 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:47.676+0000 7fda88f65a40 -1 bdev(0x55a3f0c8cc00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:39:47.683 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:47.676+0000 7fda88f65a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T09:39:48.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T09:39:48.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:39:48.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:39:48.384 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:39:48.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:39:48.510 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:39:48.510 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:39:48.511 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:39:48.511 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:39:48.511 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:39:48.511 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:39:48.540 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:48.536+0000 7fecc8bc4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:48.542 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:48.536+0000 7fecc8bc4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:48.544 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:48.540+0000 7fecc8bc4a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:48.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:39:48.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:48.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:39:48.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:48.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:48.624 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:48.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:48.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:48.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:48.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:39:48.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:48.953 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:48.948+0000 7fecc8bc4a40 -1 Falling back to public interface 2026-02-13T09:39:49.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:49.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:49.737 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:49.738 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:39:49.738 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:49.738 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:39:49.738 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:49.732+0000 7fecc8bc4a40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:39:49.849 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:50.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:50.851 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:50.851 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:39:50.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:39:50.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:50.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:39:51.068 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3507728798,v1:127.0.0.1:6801/3507728798] [v2:127.0.0.1:6802/3507728798,v1:127.0.0.1:6803/3507728798] exists,up aec6e6ff-657c-40df-909b-9ffeba987f2c 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 1 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:39:51.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:39:51.070 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:39:51.070 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:51.070 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:39:51.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:39:51.072 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:39:51.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=9c7075a5-53bb-4056-9c11-0d275aa09dee 2026-02-13T09:39:51.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 9c7075a5-53bb-4056-9c11-0d275aa09dee' 2026-02-13T09:39:51.073 INFO:tasks.workunit.client.0.trial010.stdout:add osd1 9c7075a5-53bb-4056-9c11-0d275aa09dee 2026-02-13T09:39:51.073 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:39:51.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBn8Y5pXsMLBRAAAC+j0IwVDrw8mWsKcrbLtA== 2026-02-13T09:39:51.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBn8Y5pXsMLBRAAAC+j0IwVDrw8mWsKcrbLtA=="}' 2026-02-13T09:39:51.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 9c7075a5-53bb-4056-9c11-0d275aa09dee -i td/divergent-priors/1/new.json 2026-02-13T09:39:51.303 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:51.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T09:39:51.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBn8Y5pXsMLBRAAAC+j0IwVDrw8mWsKcrbLtA== --osd-uuid 9c7075a5-53bb-4056-9c11-0d275aa09dee 2026-02-13T09:39:51.340 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:51.336+0000 7f2aeddd1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:51.342 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:51.336+0000 7f2aeddd1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:51.343 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:51.336+0000 7f2aeddd1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:51.344 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:51.336+0000 7f2aeddd1a40 -1 bdev(0x559c4c618c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T09:39:51.344 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:51.336+0000 7f2aeddd1a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T09:39:51.971 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T09:39:51.971 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:39:51.972 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T09:39:51.972 INFO:tasks.workunit.client.0.trial010.stdout:adding osd1 key to auth repository 2026-02-13T09:39:51.972 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:39:52.269 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:39:52.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T09:39:52.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:39:52.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:39:52.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:39:52.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:39:52.288 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:52.284+0000 7f5250ee1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:52.289 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:52.284+0000 7f5250ee1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:52.290 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:52.284+0000 7f5250ee1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:52.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T09:39:52.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:52.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:39:52.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:52.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:52.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:52.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:52.484 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:52.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:52.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:39:52.645 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:52.640+0000 7f5250ee1a40 -1 Falling back to public interface 2026-02-13T09:39:52.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:53.334 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:53.328+0000 7f5250ee1a40 -1 osd.1 0 log_to_monitors true 2026-02-13T09:39:53.702 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:53.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:53.703 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:53.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:39:53.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:53.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:39:53.917 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:54.918 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:54.918 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:54.919 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:39:54.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:39:54.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:54.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:39:55.136 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1635234378,v1:127.0.0.1:6811/1635234378] [v2:127.0.0.1:6812/1635234378,v1:127.0.0.1:6813/1635234378] exists,up 9c7075a5-53bb-4056-9c11-0d275aa09dee 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:64: TEST_divergent: for i in $osds 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:66: TEST_divergent: run_osd td/divergent-priors 2 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:39:55.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:39:55.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:39:55.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:39:55.140 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:39:55.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ae341549-49d8-45df-9bca-6266267141db 2026-02-13T09:39:55.142 INFO:tasks.workunit.client.0.trial010.stdout:add osd2 ae341549-49d8-45df-9bca-6266267141db 2026-02-13T09:39:55.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 ae341549-49d8-45df-9bca-6266267141db' 2026-02-13T09:39:55.143 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:39:55.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBr8Y5pF4oYCRAAAL6RUq5axNI+g2wUHdbK/g== 2026-02-13T09:39:55.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBr8Y5pF4oYCRAAAL6RUq5axNI+g2wUHdbK/g=="}' 2026-02-13T09:39:55.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ae341549-49d8-45df-9bca-6266267141db -i td/divergent-priors/2/new.json 2026-02-13T09:39:55.377 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:39:55.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T09:39:55.387 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBr8Y5pF4oYCRAAAL6RUq5axNI+g2wUHdbK/g== --osd-uuid ae341549-49d8-45df-9bca-6266267141db 2026-02-13T09:39:55.407 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:55.400+0000 7fd6c0c58a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:55.409 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:55.404+0000 7fd6c0c58a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:55.410 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:55.404+0000 7fd6c0c58a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:55.410 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:55.404+0000 7fd6c0c58a40 -1 bdev(0x55593b398c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T09:39:55.410 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:55.404+0000 7fd6c0c58a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T09:39:56.078 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T09:39:56.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:39:56.080 INFO:tasks.workunit.client.0.trial010.stdout:adding osd2 key to auth repository 2026-02-13T09:39:56.080 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T09:39:56.080 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:39:56.382 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T09:39:56.383 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:39:56.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:39:56.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:39:56.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:39:56.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:39:56.412 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:56.407+0000 7f1d212b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:56.414 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:56.407+0000 7f1d212b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:56.415 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:56.407+0000 7f1d212b2a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:39:56.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T09:39:56.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:39:56.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:39:56.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:39:56.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:39:56.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:56.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:39:56.599 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:39:56.600 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:56.600 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:39:56.819 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:56.825 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:56.819+0000 7f1d212b2a40 -1 Falling back to public interface 2026-02-13T09:39:57.431 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:39:57.423+0000 7f1d212b2a40 -1 osd.2 0 log_to_monitors true 2026-02-13T09:39:57.820 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:57.820 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:57.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:39:57.821 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:39:57.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:57.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:39:58.035 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:39:59.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:39:59.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:39:59.037 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:39:59.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:39:59.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:39:59.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:39:59.257 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/4232689628,v1:127.0.0.1:6819/4232689628] [v2:127.0.0.1:6820/4232689628,v1:127.0.0.1:6821/4232689628] exists,up ae341549-49d8-45df-9bca-6266267141db 2026-02-13T09:39:59.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:39:59.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:39:59.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:39:59.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:69: TEST_divergent: ceph osd set noout 2026-02-13T09:39:59.548 INFO:tasks.workunit.client.0.trial010.stderr:noout is set 2026-02-13T09:39:59.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:70: TEST_divergent: ceph osd set noin 2026-02-13T09:39:59.851 INFO:tasks.workunit.client.0.trial010.stderr:noin is set 2026-02-13T09:39:59.861 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:71: TEST_divergent: ceph osd set nodown 2026-02-13T09:40:00.157 INFO:tasks.workunit.client.0.trial010.stderr:nodown is set 2026-02-13T09:40:00.170 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:72: TEST_divergent: create_pool test 1 1 2026-02-13T09:40:00.170 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-13T09:40:00.412 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' already exists 2026-02-13T09:40:00.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:40:01.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:73: TEST_divergent: ceph osd pool set test size 3 2026-02-13T09:40:01.743 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 size to 3 2026-02-13T09:40:01.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:74: TEST_divergent: ceph osd pool set test min_size 2 2026-02-13T09:40:02.048 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 min_size to 2 2026-02-13T09:40:02.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:76: TEST_divergent: flush_pg_stats 2026-02-13T09:40:02.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:40:02.062 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:40:02.284 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:40:02.284 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:40:02.284 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:40:02.284 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:40:02.284 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:02.285 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:40:02.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-13T09:40:02.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-13T09:40:02.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-13T09:40:02.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:02.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:40:02.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-13T09:40:02.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-13T09:40:02.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-13T09:40:02.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:02.460 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:40:02.543 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-13T09:40:02.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-13T09:40:02.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-55834574851' 2026-02-13T09:40:02.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:02.544 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-13T09:40:02.544 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:02.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:40:02.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-13T09:40:02.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:02.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-13T09:40:02.548 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836485 2026-02-13T09:40:02.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-13T09:40:02.549 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:02.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836483 -lt 21474836485 2026-02-13T09:40:02.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:40:03.768 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:40:03.769 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:03.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-13T09:40:03.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:03.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-13T09:40:03.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:03.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:40:03.985 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-13T09:40:03.986 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:03.987 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-13T09:40:03.987 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-13T09:40:03.987 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705668 2026-02-13T09:40:03.988 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:40:04.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-13T09:40:04.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:04.219 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-13T09:40:04.219 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:04.220 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:40:04.221 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-13T09:40:04.221 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:04.222 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-13T09:40:04.222 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574851 2026-02-13T09:40:04.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-13T09:40:04.223 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574851 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:77: TEST_divergent: wait_for_clean 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:40:04.444 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:40:04.445 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:40:04.445 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:40:04.445 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:40:04.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:40:04.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:40:04.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:40:04.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:40:04.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:40:04.548 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:40:04.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:40:04.774 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:40:04.774 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:40:04.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:40:04.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:04.774 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:40:04.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-13T09:40:04.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-13T09:40:04.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-13T09:40:04.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:04.859 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:40:04.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705671 2026-02-13T09:40:04.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705671 2026-02-13T09:40:04.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671' 2026-02-13T09:40:04.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:04.942 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:40:05.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-13T09:40:05.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-13T09:40:05.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705671 2-55834574854' 2026-02-13T09:40:05.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:05.024 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-13T09:40:05.024 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:05.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:40:05.026 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-13T09:40:05.026 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:05.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-13T09:40:05.027 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836487 2026-02-13T09:40:05.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-13T09:40:05.028 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:05.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-13T09:40:05.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:40:06.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:40:06.256 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:06.471 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-13T09:40:06.471 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:06.472 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705671 2026-02-13T09:40:06.472 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:06.474 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:40:06.474 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705671 2026-02-13T09:40:06.475 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:06.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705671 2026-02-13T09:40:06.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705671' 2026-02-13T09:40:06.476 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705671 2026-02-13T09:40:06.477 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:40:06.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705671 -lt 38654705671 2026-02-13T09:40:06.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:06.700 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-13T09:40:06.700 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:06.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:40:06.702 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574854 2026-02-13T09:40:06.702 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:06.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-13T09:40:06.704 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574854 2026-02-13T09:40:06.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-13T09:40:06.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:40:06.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-13T09:40:06.927 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:40:06.927 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:06.928 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:07.219 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:40:07.219 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:07.220 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:07.220 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:07.220 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:07.220 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:07.220 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:07.221 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:07.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:40:07.434 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:07.435 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:07.435 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:07.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:40:07.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:40:07.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:40:07.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: ceph pg dump pgs --format=json 2026-02-13T09:40:07.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: jq '.pg_stats[0].up_primary' 2026-02-13T09:40:07.935 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:40:07.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:80: TEST_divergent: local divergent=1 2026-02-13T09:40:07.945 INFO:tasks.workunit.client.0.trial010.stdout:primary and soon to be divergent is 1 2026-02-13T09:40:07.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:81: TEST_divergent: echo 'primary and soon to be divergent is 1' 2026-02-13T09:40:07.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:82: TEST_divergent: ceph pg dump pgs 2026-02-13T09:40:08.144 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:40:08.144 INFO:tasks.workunit.client.0.trial010.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T09:40:00.473323+0000 0'0 26:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:15:30.715211+0000 0 0 2026-02-13T09:40:08.145 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:40:08.145 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:40:08.145 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:40:08.153 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:83: TEST_divergent: local non_divergent= 2026-02-13T09:40:08.153 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 0 = 1 ']' 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0' 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 1 = 1 ']' 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:87: TEST_divergent: continue 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:84: TEST_divergent: for i in $osds 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:86: TEST_divergent: '[' 2 = 1 ']' 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:89: TEST_divergent: non_divergent=' 0 2' 2026-02-13T09:40:08.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:92: TEST_divergent: echo 'writing initial objects' 2026-02-13T09:40:08.155 INFO:tasks.workunit.client.0.trial010.stdout:writing initial objects 2026-02-13T09:40:08.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: seq 1 100 2026-02-13T09:40:08.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_1 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.177 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.177 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_2 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_3 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.231 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.231 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_4 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.260 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.260 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_5 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.289 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_6 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_7 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_8 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_9 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_10 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_11 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_12 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_13 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.506 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.506 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_14 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_15 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_16 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_17 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_18 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.635 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.635 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_19 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.663 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.663 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_20 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.691 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.691 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_21 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_22 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.748 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.748 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_23 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.777 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.777 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_24 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.804 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.804 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_25 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_26 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_27 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.888 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.889 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_28 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_29 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.937 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_30 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.965 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.965 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_31 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:08.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:08.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_32 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_33 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.049 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.049 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_34 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.076 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.077 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_35 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.104 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.105 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_36 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_37 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.161 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.162 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_38 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_39 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_40 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_41 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_42 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_43 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_44 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_45 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.368 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.368 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_46 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.392 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.393 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_47 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_48 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_49 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_50 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_51 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_52 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_53 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_54 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_55 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_56 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_57 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_58 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_59 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.723 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.723 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_60 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.750 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_61 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_62 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.800 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_63 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_64 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.854 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.854 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_65 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_66 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_67 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.937 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_68 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.965 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.965 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_69 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:09.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:09.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_70 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_71 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.049 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.049 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_72 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.077 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.077 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_73 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.105 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.105 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_74 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_75 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.161 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.161 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_76 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_77 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_78 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_79 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_80 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.301 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.301 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_81 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_82 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_83 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.385 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.385 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_84 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_85 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_86 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.470 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.470 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_87 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.497 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.497 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_88 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_89 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_90 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_91 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.610 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.610 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_92 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.638 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.638 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_93 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.657 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.657 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_94 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.684 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.684 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_95 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_96 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_97 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_98 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.784 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.784 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_99 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:94: TEST_divergent: for i in $(seq 1 $testobjects) 2026-02-13T09:40:10.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:96: TEST_divergent: rados -p test put existing_100 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:10.838 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:40:10.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:99: TEST_divergent: wait_for_clean 2026-02-13T09:40:10.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:40:10.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:40:10.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:40:10.839 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:40:10.840 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:40:10.840 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:40:10.840 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:40:10.840 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:40:10.841 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:40:10.910 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:40:10.911 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:40:10.911 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:40:10.911 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:40:10.911 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:40:10.911 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:40:11.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:40:11.122 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:40:11.122 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:40:11.122 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:40:11.122 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:11.123 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:40:11.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-13T09:40:11.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-13T09:40:11.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491' 2026-02-13T09:40:11.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:11.205 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:40:11.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-13T09:40:11.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-13T09:40:11.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-13T09:40:11.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:11.288 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:40:11.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-13T09:40:11.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-13T09:40:11.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574857' 2026-02-13T09:40:11.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:11.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-13T09:40:11.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:11.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:40:11.370 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836491 2026-02-13T09:40:11.370 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:11.371 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836491 2026-02-13T09:40:11.372 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836491 2026-02-13T09:40:11.372 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-13T09:40:11.372 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:11.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836491 2026-02-13T09:40:11.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:40:12.590 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:40:12.591 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:12.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-13T09:40:12.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:12.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-13T09:40:12.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:12.813 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:40:12.814 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-13T09:40:12.814 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:12.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-13T09:40:12.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-13T09:40:12.816 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705674 2026-02-13T09:40:12.816 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:40:13.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-13T09:40:13.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:13.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-13T09:40:13.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:13.039 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:40:13.040 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574857 2026-02-13T09:40:13.040 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:13.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-13T09:40:13.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-13T09:40:13.042 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574857 2026-02-13T09:40:13.042 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:40:13.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-13T09:40:13.256 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:40:13.257 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:13.257 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:13.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:40:13.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:13.546 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:13.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:13.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:13.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:13.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:13.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:13.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:40:13.764 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:13.764 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:13.764 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:14.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:40:14.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:40:14.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:40:14.057 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: get_pg test existing_1 2026-02-13T09:40:14.057 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T09:40:14.057 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T09:40:14.058 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T09:40:14.058 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T09:40:14.279 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:101: TEST_divergent: local pgid=1.0 2026-02-13T09:40:14.280 INFO:tasks.workunit.client.0.trial010.stdout:blackholing osds 0 2 2026-02-13T09:40:14.280 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:104: TEST_divergent: echo 'blackholing osds 0 2' 2026-02-13T09:40:14.280 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:105: TEST_divergent: ceph pg dump pgs 2026-02-13T09:40:14.484 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:40:14.485 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T09:40:00.473323+0000 26'100 26:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:15:30.715211+0000 0 0 2026-02-13T09:40:14.485 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:40:14.485 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:40:14.485 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:40:14.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:14.494 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.0 2026-02-13T09:40:14.494 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:40:14.494 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:40:14.495 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:40:14.495 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:40:14.495 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:40:14.495 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:40:14.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-13T09:40:14.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T09:40:14.547 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:40:14.547 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:40:14.547 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:40:14.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:106: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:14.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: get_asok_path osd.2 2026-02-13T09:40:14.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:40:14.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:40:14.554 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:40:14.554 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:40:14.554 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:40:14.555 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:40:14.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: CEPH_ARGS= 2026-02-13T09:40:14.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:108: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T09:40:14.606 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:40:14.606 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:40:14.606 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:40:14.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:111: TEST_divergent: local case5=100 2026-02-13T09:40:14.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: expr 100 - 1 2026-02-13T09:40:14.613 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:112: TEST_divergent: local case3=99 2026-02-13T09:40:14.613 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:114: TEST_divergent: echo 'writing divergent object' 2026-02-13T09:40:14.613 INFO:tasks.workunit.client.0.trial010.stdout:writing divergent object 2026-02-13T09:40:14.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:116: TEST_divergent: echo 'create missing divergent object' 2026-02-13T09:40:14.614 INFO:tasks.workunit.client.0.trial010.stdout:create missing divergent object 2026-02-13T09:40:14.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:117: TEST_divergent: inject_eio rep data test existing_99 td/divergent-priors 0 2026-02-13T09:40:14.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:115: TEST_divergent: rados -p test put existing_100 /tmp/tmp.6Ydy6sgllw 2026-02-13T09:40:14.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2481: inject_eio: local pooltype=rep 2026-02-13T09:40:14.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2482: inject_eio: shift 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2483: inject_eio: local which=data 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2484: inject_eio: shift 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2485: inject_eio: local poolname=test 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2486: inject_eio: shift 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2487: inject_eio: local objname=existing_99 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2488: inject_eio: shift 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2489: inject_eio: local dir=td/divergent-priors 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2490: inject_eio: shift 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2491: inject_eio: local shard_id=0 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2492: inject_eio: shift 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: get_osds test existing_99 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1012: get_osds: local poolname=test 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1013: get_osds: local objectname=existing_99 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: ceph --format json osd map test existing_99 2026-02-13T09:40:14.617 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: jq '.acting | .[]' 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1016: get_osds: local 'osds=1 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr:0 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1018: get_osds: echo 1 0 2 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: initial_osds=('1' '0' '2') 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2494: inject_eio: local -a initial_osds 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2495: inject_eio: local osd_id=1 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2496: inject_eio: '[' rep '!=' ec ']' 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2497: inject_eio: shard_id= 2026-02-13T09:40:14.827 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: cat td/divergent-priors/1/type 2026-02-13T09:40:14.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2499: inject_eio: type=bluestore 2026-02-13T09:40:14.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2500: inject_eio: set_config osd 1 bluestore_debug_inject_read_err true 2026-02-13T09:40:14.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1152: set_config: local daemon=osd 2026-02-13T09:40:14.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1153: set_config: local id=1 2026-02-13T09:40:14.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1154: set_config: local config=bluestore_debug_inject_read_err 2026-02-13T09:40:14.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1155: set_config: local value=true 2026-02-13T09:40:14.829 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: jq 'has("success")' 2026-02-13T09:40:14.830 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: get_asok_path osd.1 2026-02-13T09:40:14.830 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:40:14.830 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:40:14.830 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:40:14.830 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:40:14.830 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:40:14.830 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:40:14.831 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: env CEPH_ARGS= ceph --format json daemon /tmp/ceph-asok.16079/ceph-osd.1.asok config set bluestore_debug_inject_read_err true 2026-02-13T09:40:14.893 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1159: set_config: test true == true 2026-02-13T09:40:14.893 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2501: inject_eio: local loop=0 2026-02-13T09:40:14.894 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2503: inject_eio: grep -q Invalid 2026-02-13T09:40:14.895 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: get_asok_path osd.1 2026-02-13T09:40:14.895 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:40:14.895 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:40:14.895 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:40:14.895 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:40:14.895 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:40:14.896 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:40:14.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: CEPH_ARGS= 2026-02-13T09:40:14.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2502: inject_eio: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.1.asok injectdataerr test existing_99 2026-02-13T09:40:14.954 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:119: TEST_divergent: sleep 10 2026-02-13T09:40:14.955 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:118: TEST_divergent: rados -p test get existing_99 td/divergent-priors/existing 2026-02-13T09:40:24.956 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:120: TEST_divergent: killall -9 rados 2026-02-13T09:40:25.005 INFO:tasks.workunit.client.0.trial010.stderr:rados: no process found 2026-02-13T09:40:25.005 INFO:tasks.workunit.client.0.trial010.stdout:killing all the osds 2026-02-13T09:40:25.005 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:123: TEST_divergent: echo 'killing all the osds' 2026-02-13T09:40:25.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:124: TEST_divergent: ceph pg dump pgs 2026-02-13T09:40:25.216 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:40:25.217 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 active+clean 2026-02-13T09:40:14.973302+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:15:30.715211+0000 0 0 2026-02-13T09:40:25.217 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:40:25.217 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:40:25.217 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:40:25.225 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:125: TEST_divergent: kill_daemons td/divergent-priors KILL osd 2026-02-13T09:40:25.226 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:40:25.226 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:40:25.226 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:40:25.227 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:40:25.227 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:40:25.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:40:25.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-13T09:40:25.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.0 2026-02-13T09:40:25.598 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:40:25.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-13T09:40:25.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.1 2026-02-13T09:40:25.904 INFO:tasks.workunit.client.0.trial010.stderr:osd.1 is already down. 2026-02-13T09:40:25.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:126: TEST_divergent: for i in $osds 2026-02-13T09:40:25.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:128: TEST_divergent: ceph osd down osd.2 2026-02-13T09:40:26.183 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already down. 2026-02-13T09:40:26.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:26.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.0 2026-02-13T09:40:26.471 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already out. 2026-02-13T09:40:26.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:130: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:26.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:132: TEST_divergent: ceph osd out osd.2 2026-02-13T09:40:26.776 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already out. 2026-02-13T09:40:26.785 INFO:tasks.workunit.client.0.trial010.stdout:bringing up non_divergent 0 2 2026-02-13T09:40:26.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:136: TEST_divergent: echo 'bringing up non_divergent 0 2' 2026-02-13T09:40:26.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:137: TEST_divergent: ceph pg dump pgs 2026-02-13T09:40:27.004 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:40:27.004 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 stale+active+clean 2026-02-13T09:40:14.973302+0000 26'101 26:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:15:30.715211+0000 0 0 2026-02-13T09:40:27.004 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:40:27.004 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:40:27.005 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:40:27.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:27.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 0 2026-02-13T09:40:27.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:40:27.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:40:27.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:40:27.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:40:27.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:40:27.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:40:27.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:40:27.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:40:27.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:40:27.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:40:27.019 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:40:27.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:40:27.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:40:27.020 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T09:40:27.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:40:27.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:40:27.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:40:27.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:40:27.041 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:27.035+0000 7f2d8d249a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:40:27.043 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:27.035+0000 7f2d8d249a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:40:27.044 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:27.035+0000 7f2d8d249a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:40:27.236 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:40:27.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:40:27.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:40:27.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:40:27.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:40:27.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:40:27.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:40:27.237 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:40:27.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:40:27.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:40:27.378 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:27.370+0000 7f2d8d249a40 -1 Falling back to public interface 2026-02-13T09:40:27.455 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:40:28.039 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:28.030+0000 7f2d8d249a40 -1 osd.0 26 log_to_monitors true 2026-02-13T09:40:28.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:40:28.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:40:28.458 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:40:28.458 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:40:28.458 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:40:28.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:40:28.677 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up out weight 0 up_from 33 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/2783404337,v1:127.0.0.1:6801/2783404337] [v2:127.0.0.1:6802/2783404337,v1:127.0.0.1:6803/2783404337] exists,up aec6e6ff-657c-40df-909b-9ffeba987f2c 2026-02-13T09:40:28.680 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:138: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:140: TEST_divergent: activate_osd td/divergent-priors 2 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:40:28.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:40:28.682 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:40:28.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:40:28.684 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:40:28.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:40:28.685 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T09:40:28.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:40:28.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:40:28.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:40:28.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:40:28.707 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:28.698+0000 7f2f456caa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:40:28.709 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:28.702+0000 7f2f456caa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:40:28.710 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:28.702+0000 7f2f456caa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:40:28.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:40:28.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:40:28.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:40:28.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:40:28.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:40:28.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:40:28.892 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:40:28.892 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:40:28.892 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:40:28.892 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:40:29.082 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:29.074+0000 7f2f456caa40 -1 Falling back to public interface 2026-02-13T09:40:29.112 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:40:29.749 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:40:29.742+0000 7f2f456caa40 -1 osd.2 26 log_to_monitors true 2026-02-13T09:40:30.114 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:40:30.114 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:40:30.114 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:40:30.115 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:40:30.115 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:40:30.115 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:40:30.334 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/1508933418,v1:127.0.0.1:6811/1508933418] [v2:127.0.0.1:6812/1508933418,v1:127.0.0.1:6813/1508933418] exists,up ae341549-49d8-45df-9bca-6266267141db 2026-02-13T09:40:30.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:40:30.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:40:30.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:40:30.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:30.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.0 2026-02-13T09:40:30.582 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already in. 2026-02-13T09:40:30.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:142: TEST_divergent: for i in $non_divergent 2026-02-13T09:40:30.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:144: TEST_divergent: ceph osd in osd.2 2026-02-13T09:40:30.872 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already in. 2026-02-13T09:40:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:40:30.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:147: TEST_divergent: wait_for_clean 2026-02-13T09:40:30.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:40:30.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:40:30.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:40:30.883 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:40:30.884 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:40:30.884 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:40:30.884 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:40:30.884 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:40:30.884 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:40:30.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:40:30.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:40:30.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:40:30.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:40:30.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:40:30.951 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:40:31.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:40:31.173 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:40:31.173 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:40:31.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:40:31.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:31.173 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:40:31.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-13T09:40:31.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-13T09:40:31.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771' 2026-02-13T09:40:31.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:31.256 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:40:31.315 INFO:tasks.workunit.client.0.trial010.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-13T09:40:31.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T09:40:31.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T09:40:31.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T09:40:31.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:40:31.317 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:40:31.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-13T09:40:31.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-13T09:40:31.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771 2-150323855363' 2026-02-13T09:40:31.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:31.398 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920771 2026-02-13T09:40:31.398 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:31.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:40:31.399 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-141733920771 2026-02-13T09:40:31.399 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:31.400 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920771 2026-02-13T09:40:31.401 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 141733920771 2026-02-13T09:40:31.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 141733920771' 2026-02-13T09:40:31.401 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:31.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 141733920771 2026-02-13T09:40:31.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:40:32.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:40:32.621 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:40:32.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920771 -lt 141733920771 2026-02-13T09:40:32.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:40:32.835 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-150323855363 2026-02-13T09:40:32.836 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:40:32.837 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:40:32.837 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-150323855363 2026-02-13T09:40:32.837 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:40:32.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855363 2026-02-13T09:40:32.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 150323855363' 2026-02-13T09:40:32.839 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 150323855363 2026-02-13T09:40:32.840 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:40:33.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-13T09:40:33.062 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:40:33.063 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:33.063 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:33.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:40:33.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:33.349 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:33.350 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:33.350 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:33.350 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:33.350 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:33.350 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:33.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:33.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:33.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:33.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:33.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:33.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T09:40:33.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T09:40:33.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T09:40:33.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:33.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T09:40:33.957 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:33.958 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:33.958 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:33.958 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:33.958 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:33.958 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:33.958 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:33.958 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:34.168 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:34.168 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:34.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:34.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:34.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:34.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:34.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:34.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:34.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:34.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:34.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:34.460 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:34.460 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:40:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:40:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:40:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T09:40:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T09:40:34.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:34.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:34.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:34.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:34.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:34.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:34.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:34.944 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:35.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:35.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:35.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:35.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:35.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:35.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:35.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:35.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:35.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:35.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:35.433 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:35.433 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:35.433 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:40:35.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:40:35.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:40:35.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T09:40:35.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:35.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T09:40:36.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:36.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:36.108 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:36.108 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:36.108 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:36.108 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:36.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:36.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:36.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:36.316 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:36.316 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:36.317 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:36.595 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:36.596 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:40:36.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:40:36.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:40:36.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T09:40:36.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:36.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T09:40:37.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:37.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:37.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:37.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:37.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:37.687 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:37.687 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:37.687 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:37.902 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:37.903 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:37.903 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:37.903 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:38.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:38.194 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:40:38.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:40:38.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:40:38.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T09:40:38.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:38.488 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T09:40:40.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:40.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:40.088 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:40.089 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:40.089 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:40.089 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:40.089 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:40.089 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:40.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:40.304 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:40.304 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:40.304 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:40.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:40.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:40.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:40.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:40.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:40.584 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:40.584 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:40.584 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:40.584 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:40:40.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:40:40.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:40:40.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T09:40:40.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:40.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T09:40:44.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:44.074 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:44.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:44.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:44.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:44.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:44.075 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:44.075 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:44.281 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:44.282 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:44.282 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:44.282 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:44.576 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:40:44.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:40:44.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:40:44.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T09:40:44.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:44.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T09:40:51.260 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:51.260 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:51.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:51.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:51.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:51.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:51.262 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:51.262 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:51.471 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:51.472 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:51.472 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:51.472 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:51.746 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:51.747 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:40:52.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:40:52.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:40:52.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T09:40:52.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:40:52.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T09:40:59.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:40:59.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:40:59.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:40:59.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:40:59.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:40:59.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:40:59.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:40:59.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:40:59.539 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:40:59.540 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:40:59.540 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:40:59.540 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:40:59.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:40:59.815 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:41:00.102 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:41:00.102 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:41:00.102 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T09:41:00.102 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T09:41:00.387 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:41:00.387 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_fingerprint": "0d78d20f-4a7e-49bb-841f-f5436f2ca5b8", 2026-02-13T09:41:00.387 INFO:tasks.workunit.client.0.trial010.stdout: "version": "20.2.0-636-g3b40640f", 2026-02-13T09:41:00.387 INFO:tasks.workunit.client.0.trial010.stdout: "commit": "3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb", 2026-02-13T09:41:00.387 INFO:tasks.workunit.client.0.trial010.stdout: "timestamp": "2026-02-13T09:41:00.382431+0000", 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "tag": "", 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "health": { 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "status": "HEALTH_WARN", 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "checks": { 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "OSDMAP_FLAGS": { 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "count": 17 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [], 2026-02-13T09:41:00.388 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: "OSD_DOWN": { 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: "message": "1 osds down", 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: "message": "osd.1 (root=default,host=trial010) is down" 2026-02-13T09:41:00.389 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "PG_DEGRADED": { 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.390 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: "mutes": [] 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_first_committed": 1, 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_last_committed": 1, 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: "monmap": { 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:41:00.391 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:39:47.226112Z", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:39:47.226112Z", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release": 20, 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release_name": "tentacle", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "election_strategy": 1, 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "disallowed_leaders": "", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": false, 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "tiebreaker_mon": "", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "removed_ranks": "", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "features": { 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "persistent": [ 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "kraken", 2026-02-13T09:41:00.392 INFO:tasks.workunit.client.0.trial010.stdout: "luminous", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "mimic", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap-prune", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "nautilus", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "octopus", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "pacific", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "elector-pinging", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "quincy", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "reef", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "squid", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "tentacle", 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: "nvmeof_beacon_diff" 2026-02-13T09:41:00.393 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "optional": [] 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "mons": [ 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "rank": 0, 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "name": "a", 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115", 2026-02-13T09:41:00.394 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 0 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: "priority": 0, 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 0, 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: "crush_location": "{}" 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: "quorum": [ 2026-02-13T09:41:00.395 INFO:tasks.workunit.client.0.trial010.stdout: 0 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap": { 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 38, 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:39:47.302859+0000", 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:40:30.914923+0000", 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "last_up_change": "2026-02-13T09:40:29.900734+0000", 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "last_in_change": "2026-02-13T09:40:30.812420+0000", 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "flags_num": 5800384, 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "flags_set": [ 2026-02-13T09:41:00.396 INFO:tasks.workunit.client.0.trial010.stdout: "nodown", 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "noin", 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "noout", 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "pglog_hardlimit", 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snapdirs", 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "recovery_deletes", 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "sortbitwise" 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "crush_version": 9, 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T09:41:00.397 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_snapshot": "", 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "pool_max": 1, 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "max_osd": 3, 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "require_min_compat_client": "luminous", 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "min_compat_client": "jewel", 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "require_osd_release": "tentacle", 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "allow_crimson": false, 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "pools": [ 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "pool_name": "test", 2026-02-13T09:41:00.398 INFO:tasks.workunit.client.0.trial010.stdout: "create_time": "2026-02-13T09:40:00.334343+0000", 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "flags": 1, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "flags_names": "hashpspool", 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "size": 3, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "min_size": 2, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "crush_rule": 0, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_count": 0, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_target": 0, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "is_stretch_pool": false, 2026-02-13T09:41:00.399 INFO:tasks.workunit.client.0.trial010.stdout: "object_hash": 2, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "pg_autoscale_mode": "off", 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num": 1, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num": 1, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num_target": 1, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_target": 1, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_pending": 1, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "last_pg_merge_meta": { 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "source_pgid": "0.0", 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "ready_epoch": 0, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_started": 0, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": 0, 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "source_version": "0'0", 2026-02-13T09:41:00.400 INFO:tasks.workunit.client.0.trial010.stdout: "target_version": "0'0" 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "last_change": "26", 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend": "0", 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "auid": 0, 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "snap_mode": "selfmanaged", 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "snap_seq": 0, 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "snap_epoch": 0, 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "pool_snaps": [], 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps": "[]", 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_bytes": 0, 2026-02-13T09:41:00.401 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_objects": 0, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "tiers": [], 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "tier_of": -1, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "read_tier": -1, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "write_tier": -1, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "cache_mode": "none", 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_bytes": 0, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_objects": 0, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_flush_age": 0, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_evict_age": 0, 2026-02-13T09:41:00.402 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profile": "", 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_params": { 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "type": "none" 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_period": 0, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_count": 0, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "use_gmt_hitset": true, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "min_read_recency_for_promote": 0, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "min_write_recency_for_promote": 0, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_search_last_n": 0, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "grade_table": [], 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "stripe_width": 0, 2026-02-13T09:41:00.403 INFO:tasks.workunit.client.0.trial010.stdout: "expected_num_objects": 0, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "fast_read": false, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "nonprimary_shards": "{}", 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "options": {}, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "application_metadata": {}, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "read_balance": { 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "score_type": "Fair distribution", 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "score_acting": 2.9900000095367432, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "score_stable": 2.9900000095367432, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_acting": 2, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_stable": 2, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity_weighted": 1, 2026-02-13T09:41:00.404 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity": 1, 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity_weighted": 1 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "osds": [ 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "aec6e6ff-657c-40df-909b-9ffeba987f2c", 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:41:00.405 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 5, 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 33, 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 37, 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 27, 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6800", 2026-02-13T09:41:00.406 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6801", 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.407 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6802", 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6803", 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6806", 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6807", 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:41:00.409 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6804", 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6805", 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2783404337 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.410 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6801/2783404337", 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6803/2783404337", 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2783404337", 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2783404337", 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "9c7075a5-53bb-4056-9c11-0d275aa09dee", 2026-02-13T09:41:00.411 INFO:tasks.workunit.client.0.trial010.stdout: "up": 0, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 0, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 0, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 9, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 20, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 28, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.412 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:41:00.413 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.414 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.415 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1635234378 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.416 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/1635234378", 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/1635234378", 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1635234378", 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1635234378", 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "exists" 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:41:00.417 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "ae341549-49d8-45df-9bca-6266267141db", 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 13, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 35, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 0, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 29, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.418 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:41:00.419 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.420 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.421 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1508933418 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.422 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/1508933418", 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/1508933418", 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1508933418", 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1508933418", 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.423 INFO:tasks.workunit.client.0.trial010.stdout: "osd_xinfo": [ 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:40:25.538948+0000", 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.424 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:40:25.844195+0000", 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:40:26.123348+0000", 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:41:00.425 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap": [], 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_items": [], 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_primaries": [], 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "pg_temp": [], 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "primary_temp": [], 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "blocklist": {}, 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "range_blocklist": {}, 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profiles": { 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "default": { 2026-02-13T09:41:00.426 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "m": "2", 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps_queue": [], 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "new_removed_snaps": [], 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "new_purged_snaps": [], 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "crush_node_flags": {}, 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "device_class_flags": {}, 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": { 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_enabled": false, 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_bucket_count": 0, 2026-02-13T09:41:00.427 INFO:tasks.workunit.client.0.trial010.stdout: "degraded_stretch_mode": 0, 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "recovering_stretch_mode": 0, 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_bucket": 0 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "osd_metadata": [ 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6802/2783404337,v1:127.0.0.1:6803/2783404337]", 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:41:00.428 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:41:00.429 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:39:48.216383Z", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6800/2783404337,v1:127.0.0.1:6801/2783404337]", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2783404337,v1:127.0.0.1:6807/2783404337]", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2783404337,v1:127.0.0.1:6805/2783404337]", 2026-02-13T09:41:00.430 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.431 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/1635234378,v1:127.0.0.1:6813/1635234378]", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:41:00.432 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:39:51.868702Z", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:41:00.433 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/1635234378,v1:127.0.0.1:6811/1635234378]", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1635234378,v1:127.0.0.1:6817/1635234378]", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1635234378,v1:127.0.0.1:6815/1635234378]", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:41:00.434 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/1508933418,v1:127.0.0.1:6813/1508933418]", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:41:00.435 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:39:55.960987Z", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:41:00.436 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/1508933418,v1:127.0.0.1:6811/1508933418]", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1508933418,v1:127.0.0.1:6817/1508933418]", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1508933418,v1:127.0.0.1:6815/1508933418]", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T09:41:00.437 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_clean_epochs": { 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "min_last_epoch_clean": 0, 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": { 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "per_pool": [] 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "osd_epochs": [] 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_first_committed": 1, 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_last_committed": 38, 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "crushmap": { 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "devices": [ 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.0", 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:41:00.438 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.1", 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.2", 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "types": [ 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 0, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd" 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: "name": "host" 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.439 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 2, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "name": "chassis" 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 3, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "name": "rack" 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 4, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "name": "row" 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 5, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pdu" 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 6, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pod" 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 7, 2026-02-13T09:41:00.440 INFO:tasks.workunit.client.0.trial010.stdout: "name": "room" 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 8, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "name": "datacenter" 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 9, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "name": "zone" 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 10, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "name": "region" 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "name": "root" 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "buckets": [ 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "id": -1, 2026-02-13T09:41:00.441 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "id": -2, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default~ssd", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:41:00.442 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010", 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.443 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010~ssd", 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.444 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "rules": [ 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 0, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "replicated_rule", 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.445 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_firstn", 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "tunables": { 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_tries": 0, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_fallback_tries": 0, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "choose_total_tries": 50, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_descend_once": 1, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_vary_r": 1, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_stable": 1, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "msr_descents": 100, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "msr_collision_tries": 100, 2026-02-13T09:41:00.446 INFO:tasks.workunit.client.0.trial010.stdout: "straw_calc_version": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "allowed_bucket_algs": 54, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "profile": "jewel", 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_tunables": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "legacy_tunables": 0, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "minimum_required_version": "jewel", 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables2": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "has_v2_rules": 0, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables3": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "has_v3_rules": 0, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "has_v4_buckets": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables5": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "has_v5_rules": 0, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "has_msr_rules": 0 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "choose_args": {} 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "fsmap": { 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "btime": "2026-02-13T09:39:47:302643+0000", 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "default_fscid": -1, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "compat": { 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "compat": {}, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "ro_compat": {}, 2026-02-13T09:41:00.447 INFO:tasks.workunit.client.0.trial010.stdout: "incompat": { 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_1": "base v0.20", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stderr:report 479684764 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_2": "client writeable ranges", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_4": "dir inode in separate object", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_8": "no anchor table", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_9": "file layout v2", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_10": "snaprealm v2", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_11": "minor log segments", 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T09:41:00.448 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "feature_flags": { 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "enable_multiple": true, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "ever_enabled_multiple": true 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "standbys": [], 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "filesystems": [] 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_first_committed": 1, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_last_committed": 1, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "auth": { 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 5, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_secrets": 3 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_active": 1, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_unknown": 0, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_osd": 3, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "pool_sum": { 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51200, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:41:00.449 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 100, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 100, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:41:00.450 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 16, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 16, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "up": 2, 2026-02-13T09:41:00.451 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 2, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 0 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum": { 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83820, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2040, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 22, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81705, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488980, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036715520, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2088960, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 410164, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 23446, 2026-02-13T09:41:00.452 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83666026 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 1, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum_by_class": { 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "ssd": { 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:41:00.453 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83820, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2040, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 22, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81705, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488980, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036715520, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2088960, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 410164, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 23446, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83666026 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 1, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:41:00.454 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "pool_stats": [ 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51200, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 100, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 100, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:41:00.455 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 1228800, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 153600, 2026-02-13T09:41:00.456 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 16, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 16, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "up": 2, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 2, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 3 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "osd_stats": [ 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 141733920777 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 38654705677 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 150323855368 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_state": [ 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.457 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded", 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num": 1 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "pool_pg_unavailable_map": [ 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": "1", 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "pgs": [] 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_osd": [ 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 1, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 0, 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.458 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": [ 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": {} 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "servicemap": { 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 3, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:40:55.738058+0000", 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "services": { 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "osd": { 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "daemons": { 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "summary": "", 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "0": { 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "2": { 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.459 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_first_committed": 1, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_last_committed": 37, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "logm_first_committed": 1, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "logm_last_committed": 217, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "paxos": { 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 301, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "last_pn": 0, 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: "accepted_pn": 0 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: expr 2 + 2 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:150: TEST_divergent: objname=existing_4 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stdout:writing non-divergent object existing_4 2026-02-13T09:41:00.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:151: TEST_divergent: echo 'writing non-divergent object existing_4' 2026-02-13T09:41:00.461 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:152: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:00.602 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:00.602 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:40:30.917722+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:47:04.187581+0000 0 0 2026-02-13T09:41:00.602 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:00.602 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:00.603 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:00.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: dd if=/dev/urandom bs=1000 count=1 2026-02-13T09:41:00.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:154: TEST_divergent: rados -p test put existing_4 - 2026-02-13T09:41:00.613 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:41:00.613 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:41:00.613 INFO:tasks.workunit.client.0.trial010.stderr:1000 bytes (1.0 kB) copied, 3.0847e-05 s, 32.4 MB/s 2026-02-13T09:41:00.634 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery 2026-02-13T09:41:00.634 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:157: TEST_divergent: echo 'delay recovery' 2026-02-13T09:41:00.634 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:158: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:00.837 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:00.837 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:40:30.917722+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:47:04.187581+0000 0 0 2026-02-13T09:41:00.837 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:00.837 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:00.837 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:00.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-13T09:41:00.846 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.0 2026-02-13T09:41:00.846 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:41:00.847 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:41:00.847 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:41:00.847 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:00.847 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:00.847 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:41:00.847 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-13T09:41:00.848 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T09:41:00.902 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:41:00.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:159: TEST_divergent: for i in $non_divergent 2026-02-13T09:41:00.908 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: get_asok_path osd.2 2026-02-13T09:41:00.908 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:41:00.909 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:41:00.909 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:41:00.909 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:00.909 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:00.909 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:41:00.910 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: CEPH_ARGS= 2026-02-13T09:41:00.910 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:161: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T09:41:00.963 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:41:00.969 INFO:tasks.workunit.client.0.trial010.stdout:revive divergent 1 2026-02-13T09:41:00.969 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:165: TEST_divergent: echo 'revive divergent 1' 2026-02-13T09:41:00.969 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:166: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:01.170 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:01.170 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:40:30.917722+0000 26'100 38:130 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:47:04.187581+0000 0 0 2026-02-13T09:41:01.170 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:01.170 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:01.171 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:01.179 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:167: TEST_divergent: ceph osd set noup 2026-02-13T09:41:01.508 INFO:tasks.workunit.client.0.trial010.stderr:noup is set 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:168: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:41:01.522 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:41:01.523 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:41:01.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:41:01.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:41:01.525 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:41:01.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:41:01.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:41:01.526 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:41:01.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:41:01.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:41:01.527 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:41:01.527 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:41:01.549 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:01.541+0000 7fce9ae78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:01.550 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:01.541+0000 7fce9ae78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:01.551 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:01.541+0000 7fce9ae78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:01.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T09:41:01.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:169: TEST_divergent: sleep 5 2026-02-13T09:41:01.886 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:01.877+0000 7fce9ae78a40 -1 Falling back to public interface 2026-02-13T09:41:02.517 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:02.505+0000 7fce9ae78a40 -1 osd.1 26 log_to_monitors true 2026-02-13T09:41:06.742 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery divergent 2026-02-13T09:41:06.743 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:171: TEST_divergent: echo 'delay recovery divergent' 2026-02-13T09:41:06.743 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:172: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:06.939 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:06.940 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:40:30.917722+0000 38'101 39:133 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:47:04.187581+0000 0 0 2026-02-13T09:41:06.940 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:06.940 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:06.940 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:06.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: get_asok_path osd.1 2026-02-13T09:41:06.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:41:06.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:41:06.950 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:41:06.950 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:06.950 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:06.950 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:41:06.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: CEPH_ARGS= 2026-02-13T09:41:06.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:173: TEST_divergent: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T09:41:07.005 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:41:07.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:175: TEST_divergent: ceph osd unset noup 2026-02-13T09:41:07.334 INFO:tasks.workunit.client.0.trial010.stderr:noup is unset 2026-02-13T09:41:07.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:177: TEST_divergent: wait_for_osd up 0 2026-02-13T09:41:07.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:41:07.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:41:07.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:41:07.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:41:07.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:07.346 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:07.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:41:07.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:07.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:41:07.557 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 33 up_thru 37 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/2783404337,v1:127.0.0.1:6801/2783404337] [v2:127.0.0.1:6802/2783404337,v1:127.0.0.1:6803/2783404337] exists,up aec6e6ff-657c-40df-909b-9ffeba987f2c 2026-02-13T09:41:07.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:41:07.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:178: TEST_divergent: wait_for_osd up 1 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:41:07.559 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:07.560 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:07.560 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:41:07.769 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/1819145714,v1:127.0.0.1:6819/1819145714] [v2:127.0.0.1:6820/1819145714,v1:127.0.0.1:6821/1819145714] exists,up 9c7075a5-53bb-4056-9c11-0d275aa09dee 2026-02-13T09:41:07.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:41:07.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:41:07.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:41:07.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:179: TEST_divergent: wait_for_osd up 2 2026-02-13T09:41:07.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:41:07.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:41:07.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:41:07.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:41:07.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:07.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:41:07.771 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:07.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:07.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:41:07.989 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 35 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/1508933418,v1:127.0.0.1:6811/1508933418] [v2:127.0.0.1:6812/1508933418,v1:127.0.0.1:6813/1508933418] exists,up ae341549-49d8-45df-9bca-6266267141db 2026-02-13T09:41:07.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:41:07.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:41:07.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:41:07.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:181: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:08.193 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:08.193 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-13T09:41:07.332803+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:41:08.193 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:08.193 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:08.193 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:08.202 INFO:tasks.workunit.client.0.trial010.stdout:wait for peering 2026-02-13T09:41:08.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:182: TEST_divergent: echo 'wait for peering' 2026-02-13T09:41:08.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:183: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:08.412 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:08.412 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-13T09:41:07.332803+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:41:08.412 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:08.412 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:08.412 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:08.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:184: TEST_divergent: rados -p test put foo /tmp/tmp.6Ydy6sgllw 2026-02-13T09:41:08.452 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:186: TEST_divergent: echo 'killing divergent 1' 2026-02-13T09:41:08.452 INFO:tasks.workunit.client.0.trial010.stdout:killing divergent 1 2026-02-13T09:41:08.452 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:187: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:08.652 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:08.652 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-13T09:41:07.332803+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:41:08.652 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:08.652 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:08.653 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:08.661 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:188: TEST_divergent: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T09:41:08.662 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:41:08.662 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:41:08.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:41:08.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:41:08.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:41:08.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:41:08.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:190: TEST_divergent: echo 'reviving divergent 1' 2026-02-13T09:41:08.770 INFO:tasks.workunit.client.0.trial010.stdout:reviving divergent 1 2026-02-13T09:41:08.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:191: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:08.970 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:08.970 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 17 84 17 peering 2026-02-13T09:41:07.332803+0000 26'101 43:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:41:08.970 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:08.970 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:08.970 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:192: TEST_divergent: activate_osd td/divergent-priors 1 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:41:08.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:08.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:41:08.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:41:08.985 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:41:08.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:41:08.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:41:08.986 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:41:08.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:41:08.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:41:08.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:41:08.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:41:09.009 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:09.001+0000 7f7bff5f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:09.011 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:09.001+0000 7f7bff5f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:09.012 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:09.001+0000 7f7bff5f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:09.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:41:09.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:41:09.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:41:09.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:41:09.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:41:09.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:09.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:41:09.207 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:09.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:09.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:41:09.394 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:09.385+0000 7f7bff5f1a40 -1 Falling back to public interface 2026-02-13T09:41:09.422 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 43 up_thru 43 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/1819145714,v1:127.0.0.1:6819/1819145714] [v2:127.0.0.1:6820/1819145714,v1:127.0.0.1:6821/1819145714] exists,up 9c7075a5-53bb-4056-9c11-0d275aa09dee 2026-02-13T09:41:09.422 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:41:09.422 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:41:09.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:41:09.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:194: TEST_divergent: sleep 20 2026-02-13T09:41:10.085 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:10.077+0000 7f7bff5f1a40 -1 osd.1 44 log_to_monitors true 2026-02-13T09:41:29.423 INFO:tasks.workunit.client.0.trial010.stdout:allowing recovery 2026-02-13T09:41:29.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:196: TEST_divergent: echo 'allowing recovery' 2026-02-13T09:41:29.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:197: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:29.625 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:29.625 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-13T09:41:10.916082+0000 44'102 48:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:46:59.970961+0000 0 0 2026-02-13T09:41:29.625 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:29.625 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:29.625 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:29.634 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-13T09:41:29.634 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T09:41:29.721 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:41:29.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-13T09:41:29.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T09:41:29.806 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:41:29.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:199: TEST_divergent: for i in $osds 2026-02-13T09:41:29.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:201: TEST_divergent: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T09:41:29.889 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:41:29.896 INFO:tasks.workunit.client.0.trial010.stdout:reading divergent objects 2026-02-13T09:41:29.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:204: TEST_divergent: echo 'reading divergent objects' 2026-02-13T09:41:29.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:205: TEST_divergent: ceph pg dump pgs 2026-02-13T09:41:30.115 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:30.115 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 0 0 0 52200 0 0 18 84 18 active+clean 2026-02-13T09:41:10.916082+0000 44'102 48:159 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:40:00.355457+0000 0'0 2026-02-13T09:40:00.355457+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:46:59.970961+0000 0 0 2026-02-13T09:41:30.115 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:30.115 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:30.116 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:30.124 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: expr 2 + 2 2026-02-13T09:41:30.125 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: seq 1 4 2026-02-13T09:41:30.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:41:30.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T09:41:30.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:41:30.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T09:41:30.178 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:41:30.178 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T09:41:30.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:206: TEST_divergent: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:41:30.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:208: TEST_divergent: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T09:41:30.229 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:210: TEST_divergent: rm -f td/divergent-priors/existing 2026-02-13T09:41:30.231 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-13T09:41:30.232 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:212: TEST_divergent: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:41:30.236 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-13T09:40:14.629309+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T09:41:30.236 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 20 _merge_object_divergent_entries: keeping 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-13T09:40:14.629309+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T09:41:30.236 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:41:30.236 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 26'100 first_divergent_update: 26'101 last_divergent_update: 26'101 2026-02-13T09:41:30.237 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-13T09:41:30.237 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:41:30.237 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 26'101 2026-02-13T09:41:30.237 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4534.0:1 2026-02-13T09:40:14.629309+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T09:41:30.237 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:41:07.745+0000 7fce785f5640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-13T09:41:30.237 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: find td/divergent-priors -name '*osd*log' 2026-02-13T09:41:30.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:214: TEST_divergent: grep -q '_merge_object_divergent_entries.*cannot roll back, removing and adding to missing' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:41:30.241 INFO:tasks.workunit.client.0.trial010.stdout:success 2026-02-13T09:41:30.241 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:219: TEST_divergent: echo success 2026-02-13T09:41:30.241 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:221: TEST_divergent: rm -f /tmp/tmp.6Ydy6sgllw 2026-02-13T09:41:30.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:222: TEST_divergent: delete_pool test 2026-02-13T09:41:30.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T09:41:30.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T09:41:30.500 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' does not exist 2026-02-13T09:41:30.510 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:223: TEST_divergent: kill_daemons td/divergent-priors 2026-02-13T09:41:30.511 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:41:30.511 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:41:30.511 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:41:30.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:41:30.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:41:30.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:41:30.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T09:41:30.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:41:30.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:41:30.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:41:30.822 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:41:30.823 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:41:30.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:41:30.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:41:30.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:41:30.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:41:30.829 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:41:30.830 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:41:30.831 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:41:30.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:41:30.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:41:30.832 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:41:30.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:41:30.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:41:30.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:41:30.834 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:41:30.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:41:30.836 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:41:30.836 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:41:30.855 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:41:30.855 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:30.855 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:30.855 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:41:30.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:41:30.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:41:30.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:41:30.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:41:30.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:41:30.860 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:41:30.861 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:41:30.861 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:41:30.862 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:41:30.862 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:41:30.862 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:41:30.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:41:30.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:41:30.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:41:30.864 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:41:30.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:41:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:41:30.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:41:30.867 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:41:30.867 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:30.867 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:30.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:41:30.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:41:30.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:41:30.869 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T09:41:30.870 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:41:30.870 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:30.870 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:30.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16079 2026-02-13T09:41:30.872 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_2 td/divergent-priors 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:422: TEST_divergent_2: local dir=td/divergent-priors 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: file_with_random_data 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-13T09:41:30.873 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-13T09:41:30.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:30.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.WuVyKlVMjN bs=512 count=1 2026-02-13T09:41:30.875 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:41:30.875 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:41:30.875 INFO:tasks.workunit.client.0.trial010.stderr:512 bytes copied, 0.000225757 s, 2.3 MB/s 2026-02-13T09:41:30.875 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:30.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:424: TEST_divergent_2: local dummyfile=/tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:30.876 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: file_with_random_data 1000 2026-02-13T09:41:30.876 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-13T09:41:30.876 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-13T09:41:30.877 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.gdb2r6WdO2 2026-02-13T09:41:30.877 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.gdb2r6WdO2 bs=1000 count=1 2026-02-13T09:41:30.878 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:41:30.878 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:41:30.878 INFO:tasks.workunit.client.0.trial010.stderr:1000 bytes (1.0 kB) copied, 0.000100075 s, 10.0 MB/s 2026-02-13T09:41:30.878 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.gdb2r6WdO2 2026-02-13T09:41:30.879 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:426: TEST_divergent_2: local dummyfile2=/tmp/tmp.gdb2r6WdO2 2026-02-13T09:41:30.879 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:428: TEST_divergent_2: local num_osds=3 2026-02-13T09:41:30.879 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: expr 3 - 1 2026-02-13T09:41:30.880 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: seq 0 2 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:429: TEST_divergent_2: local 'osds=0 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:430: TEST_divergent_2: run_mon td/divergent-priors a 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T09:41:30.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T09:41:30.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:41:30.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:41:30.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:41:30.906 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:41:30.906 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:30.906 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:30.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:30.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:41:30.935 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:41:30.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:41:30.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:41:30.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:41:30.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:41:30.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:41:30.938 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:41:30.938 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:41:30.938 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:41:30.939 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:41:30.939 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:30.939 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:30.940 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:41:30.940 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:41:30.940 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get fsid 2026-02-13T09:41:30.994 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:41:30.994 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:41:30.994 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:41:30.994 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:41:30.994 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:41:30.994 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:41:30.995 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get mon_host 2026-02-13T09:41:31.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:431: TEST_divergent_2: run_mgr td/divergent-priors x 2026-02-13T09:41:31.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T09:41:31.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:41:31.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:41:31.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:41:31.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T09:41:31.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:41:31.163 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:41:31.163 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:41:31.163 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:41:31.163 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:41:31.163 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:31.164 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:31.164 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:31.164 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:41:31.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:41:31.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 0 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:41:31.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:31.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:41:31.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:41:31.191 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:41:31.191 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=11c37136-8f50-40ec-8bba-e112620a13e3 2026-02-13T09:41:31.191 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 11c37136-8f50-40ec-8bba-e112620a13e3' 2026-02-13T09:41:31.192 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 11c37136-8f50-40ec-8bba-e112620a13e3 2026-02-13T09:41:31.192 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:41:31.203 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDL8Y5pexfECxAAhenlq1Xa2kpFPkgzU7vAig== 2026-02-13T09:41:31.203 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDL8Y5pexfECxAAhenlq1Xa2kpFPkgzU7vAig=="}' 2026-02-13T09:41:31.203 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 11c37136-8f50-40ec-8bba-e112620a13e3 -i td/divergent-priors/0/new.json 2026-02-13T09:41:31.317 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:31.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T09:41:31.327 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDL8Y5pexfECxAAhenlq1Xa2kpFPkgzU7vAig== --osd-uuid 11c37136-8f50-40ec-8bba-e112620a13e3 2026-02-13T09:41:31.346 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:31.340+0000 7ff24aa39a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:31.347 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:31.340+0000 7ff24aa39a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:31.348 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:31.340+0000 7ff24aa39a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:31.349 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:31.340+0000 7ff24aa39a40 -1 bdev(0x563653ccec00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:41:31.349 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:31.340+0000 7ff24aa39a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T09:41:32.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T09:41:32.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:41:32.062 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:41:32.063 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:41:32.063 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:41:32.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:41:32.186 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:41:32.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:41:32.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:41:32.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:41:32.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:41:32.215 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:32.208+0000 7f33adf5ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:32.217 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:32.208+0000 7f33adf5ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:32.218 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:32.212+0000 7f33adf5ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:32.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:41:32.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:41:32.304 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:41:32.304 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:41:32.304 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:41:32.304 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:32.304 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:41:32.304 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:32.305 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:32.305 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:41:32.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:41:32.659 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:32.652+0000 7f33adf5ba40 -1 Falling back to public interface 2026-02-13T09:41:33.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:41:33.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:33.415 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:41:33.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:41:33.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:33.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:41:33.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:41:33.636 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:33.628+0000 7f33adf5ba40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:41:34.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:41:34.525 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:34.526 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:41:34.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:41:34.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:34.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:41:34.736 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2972594087,v1:127.0.0.1:6801/2972594087] [v2:127.0.0.1:6802/2972594087,v1:127.0.0.1:6803/2972594087] exists,up 11c37136-8f50-40ec-8bba-e112620a13e3 2026-02-13T09:41:34.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:41:34.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:41:34.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:41:34.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-13T09:41:34.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 1 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:41:34.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:41:34.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:41:34.742 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:41:34.743 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ecf85c02-d562-4877-83ef-3e5a28190370 2026-02-13T09:41:34.743 INFO:tasks.workunit.client.0.trial010.stdout:add osd1 ecf85c02-d562-4877-83ef-3e5a28190370 2026-02-13T09:41:34.744 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ecf85c02-d562-4877-83ef-3e5a28190370' 2026-02-13T09:41:34.744 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:41:34.754 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDO8Y5pDA+wLBAAN1brS/qmr9yDrR2wyTmeFw== 2026-02-13T09:41:34.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDO8Y5pDA+wLBAAN1brS/qmr9yDrR2wyTmeFw=="}' 2026-02-13T09:41:34.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ecf85c02-d562-4877-83ef-3e5a28190370 -i td/divergent-priors/1/new.json 2026-02-13T09:41:34.969 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:41:34.978 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T09:41:34.978 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDO8Y5pDA+wLBAAN1brS/qmr9yDrR2wyTmeFw== --osd-uuid ecf85c02-d562-4877-83ef-3e5a28190370 2026-02-13T09:41:34.998 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:34.992+0000 7f8516f19a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:34.999 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:34.992+0000 7f8516f19a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:35.000 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:34.992+0000 7f8516f19a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:35.000 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:34.992+0000 7f8516f19a40 -1 bdev(0x55b6b57c4c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T09:41:35.000 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:34.992+0000 7f8516f19a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T09:41:35.668 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T09:41:35.668 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:41:35.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T09:41:35.669 INFO:tasks.workunit.client.0.trial010.stdout:adding osd1 key to auth repository 2026-02-13T09:41:35.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:41:35.975 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:41:35.975 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T09:41:35.975 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:41:35.975 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:41:35.976 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:41:35.976 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:41:35.993 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:35.988+0000 7fd3c7fb5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:35.995 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:35.988+0000 7fd3c7fb5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:35.996 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:35.988+0000 7fd3c7fb5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:41:36.195 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:36.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:36.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:41:36.359 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:36.352+0000 7fd3c7fb5a40 -1 Falling back to public interface 2026-02-13T09:41:36.407 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:41:36.999 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:36.992+0000 7fd3c7fb5a40 -1 osd.1 0 log_to_monitors true 2026-02-13T09:41:37.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:41:37.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:37.408 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:41:37.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:41:37.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:37.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:41:37.629 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/4179701101,v1:127.0.0.1:6811/4179701101] [v2:127.0.0.1:6812/4179701101,v1:127.0.0.1:6813/4179701101] exists,up ecf85c02-d562-4877-83ef-3e5a28190370 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:432: TEST_divergent_2: for i in $osds 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:434: TEST_divergent_2: run_osd td/divergent-priors 2 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:41:37.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:37.631 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:41:37.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:41:37.633 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:41:37.634 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197 2026-02-13T09:41:37.634 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197' 2026-02-13T09:41:37.634 INFO:tasks.workunit.client.0.trial010.stdout:add osd2 35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197 2026-02-13T09:41:37.634 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:41:37.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDR8Y5pq31fJhAA6gkvoQld9og512fEcyNZ9Q== 2026-02-13T09:41:37.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDR8Y5pq31fJhAA6gkvoQld9og512fEcyNZ9Q=="}' 2026-02-13T09:41:37.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197 -i td/divergent-priors/2/new.json 2026-02-13T09:41:37.866 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:41:37.874 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T09:41:37.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDR8Y5pq31fJhAA6gkvoQld9og512fEcyNZ9Q== --osd-uuid 35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197 2026-02-13T09:41:37.894 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:37.888+0000 7fdd58a47a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:37.896 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:37.888+0000 7fdd58a47a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:37.897 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:37.888+0000 7fdd58a47a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:37.897 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:37.892+0000 7fdd58a47a40 -1 bdev(0x55c142c20c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T09:41:37.898 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:37.892+0000 7fdd58a47a40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T09:41:38.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T09:41:38.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:41:38.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T09:41:38.493 INFO:tasks.workunit.client.0.trial010.stdout:adding osd2 key to auth repository 2026-02-13T09:41:38.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:41:38.790 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:41:38.791 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T09:41:38.791 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:41:38.791 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:41:38.791 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:41:38.791 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:41:38.809 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:38.800+0000 7f011f0f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:38.810 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:38.804+0000 7f011f0f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:38.811 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:38.804+0000 7f011f0f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:41:39.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T09:41:39.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:41:39.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:41:39.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:41:39.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:41:39.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:39.010 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:41:39.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:41:39.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:39.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:41:39.183 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:39.176+0000 7f011f0f1a40 -1 Falling back to public interface 2026-02-13T09:41:39.226 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:41:39.876 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:41:39.868+0000 7f011f0f1a40 -1 osd.2 0 log_to_monitors true 2026-02-13T09:41:40.227 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:41:40.227 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:40.227 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:41:40.228 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:41:40.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:40.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:41:40.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:41:41.449 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:41:41.449 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:41:41.449 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:41:41.450 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:41:41.450 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:41:41.450 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:41:41.669 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/712017814,v1:127.0.0.1:6819/712017814] [v2:127.0.0.1:6820/712017814,v1:127.0.0.1:6821/712017814] exists,up 35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197 2026-02-13T09:41:41.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:41:41.670 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:41:41.670 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:41:41.670 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:437: TEST_divergent_2: ceph osd set noout 2026-02-13T09:41:41.960 INFO:tasks.workunit.client.0.trial010.stderr:noout is set 2026-02-13T09:41:41.969 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:438: TEST_divergent_2: ceph osd set noin 2026-02-13T09:41:42.263 INFO:tasks.workunit.client.0.trial010.stderr:noin is set 2026-02-13T09:41:42.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:439: TEST_divergent_2: ceph osd set nodown 2026-02-13T09:41:42.567 INFO:tasks.workunit.client.0.trial010.stderr:nodown is set 2026-02-13T09:41:42.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:440: TEST_divergent_2: create_pool test 1 1 2026-02-13T09:41:42.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-13T09:41:42.821 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' already exists 2026-02-13T09:41:42.830 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:41:43.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:441: TEST_divergent_2: ceph osd pool set test size 3 2026-02-13T09:41:44.141 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 size to 3 2026-02-13T09:41:44.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:442: TEST_divergent_2: ceph osd pool set test min_size 2 2026-02-13T09:41:44.447 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 min_size to 2 2026-02-13T09:41:44.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:444: TEST_divergent_2: flush_pg_stats 2026-02-13T09:41:44.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:41:44.460 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:41:44.674 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:41:44.674 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:41:44.674 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:41:44.674 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:41:44.674 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:44.675 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:41:44.758 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-13T09:41:44.758 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-13T09:41:44.758 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-13T09:41:44.759 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:44.759 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:41:44.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-13T09:41:44.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-13T09:41:44.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-13T09:41:44.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:44.840 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:41:44.924 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-13T09:41:44.924 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-13T09:41:44.924 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574851' 2026-02-13T09:41:44.924 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:44.925 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-13T09:41:44.925 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:44.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:41:44.927 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-13T09:41:44.927 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:44.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-13T09:41:44.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-13T09:41:44.929 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836484 2026-02-13T09:41:44.929 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:41:45.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-13T09:41:45.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:41:46.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:41:46.153 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:41:46.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-13T09:41:46.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:46.376 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-13T09:41:46.376 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:46.377 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:41:46.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-13T09:41:46.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:46.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-13T09:41:46.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-13T09:41:46.380 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705668 2026-02-13T09:41:46.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:41:46.607 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-13T09:41:46.607 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:46.608 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-13T09:41:46.608 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:46.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:41:46.610 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-13T09:41:46.610 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:46.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-13T09:41:46.612 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574851 2026-02-13T09:41:46.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-13T09:41:46.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:41:46.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-13T09:41:46.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:445: TEST_divergent_2: wait_for_clean 2026-02-13T09:41:46.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:41:46.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:41:46.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:41:46.835 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:41:46.836 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:41:46.836 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:41:46.836 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:41:46.836 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:41:46.836 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:41:46.937 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:41:46.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:41:46.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:41:46.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:41:46.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:41:46.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:41:47.163 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:41:47.164 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:41:47.164 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:41:47.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:41:47.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:47.164 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:41:47.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-13T09:41:47.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-13T09:41:47.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-13T09:41:47.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:47.245 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:41:47.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-13T09:41:47.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-13T09:41:47.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-13T09:41:47.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:47.326 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:41:47.406 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-13T09:41:47.406 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-13T09:41:47.406 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574854' 2026-02-13T09:41:47.406 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:47.407 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-13T09:41:47.407 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:47.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:41:47.408 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-13T09:41:47.409 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:47.410 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-13T09:41:47.410 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836487 2026-02-13T09:41:47.411 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-13T09:41:47.411 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:41:47.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-13T09:41:47.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:47.628 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-13T09:41:47.628 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:47.629 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:41:47.630 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705670 2026-02-13T09:41:47.630 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:47.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705670 2026-02-13T09:41:47.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-13T09:41:47.632 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705670 2026-02-13T09:41:47.632 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:41:47.853 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-13T09:41:47.853 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:47.853 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-13T09:41:47.854 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:47.855 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:41:47.855 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574854 2026-02-13T09:41:47.856 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:47.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-13T09:41:47.857 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574854 2026-02-13T09:41:47.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-13T09:41:47.858 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:41:48.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574854 2026-02-13T09:41:48.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:41:49.089 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:41:49.090 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:41:49.301 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574852 -lt 55834574854 2026-02-13T09:41:49.301 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:41:50.302 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T09:41:50.303 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:41:50.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-13T09:41:50.524 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:41:50.525 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:41:50.525 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:41:50.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:41:50.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:41:50.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:41:50.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:41:50.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:41:50.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:41:50.813 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:41:50.813 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:41:51.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:41:51.019 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:41:51.019 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:41:51.019 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:41:51.296 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:41:51.296 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:41:51.296 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:41:51.297 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: ceph pg dump pgs --format=json 2026-02-13T09:41:51.297 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: jq '.pg_stats[0].up_primary' 2026-02-13T09:41:51.498 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:51.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:448: TEST_divergent_2: local divergent=1 2026-02-13T09:41:51.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:449: TEST_divergent_2: echo 'primary and soon to be divergent is 1' 2026-02-13T09:41:51.508 INFO:tasks.workunit.client.0.trial010.stdout:primary and soon to be divergent is 1 2026-02-13T09:41:51.508 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:450: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:41:51.715 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:51.715 INFO:tasks.workunit.client.0.trial010.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T09:41:42.906558+0000 0'0 26:22 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:09:56.268948+0000 0 0 2026-02-13T09:41:51.715 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:51.715 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:51.715 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:51.724 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:451: TEST_divergent_2: local non_divergent= 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 0 = 1 ']' 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0' 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 1 = 1 ']' 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:455: TEST_divergent_2: continue 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:452: TEST_divergent_2: for i in $osds 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:454: TEST_divergent_2: '[' 2 = 1 ']' 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:457: TEST_divergent_2: non_divergent=' 0 2' 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:460: TEST_divergent_2: echo 'writing initial objects' 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stdout:writing initial objects 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: seq 1 100 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.748 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.748 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.777 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.777 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_3 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.804 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.804 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_5 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_6 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.887 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.887 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_7 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_8 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.944 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.944 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_9 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.971 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.971 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_10 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:51.999 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:51.999 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_11 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_12 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_13 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.083 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.083 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_14 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.111 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.112 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_15 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_16 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.167 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.167 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_17 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_18 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_19 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_20 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.278 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.279 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_21 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_22 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_23 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.363 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.363 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_24 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.391 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.391 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_25 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.419 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.419 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_26 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_27 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_28 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_29 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_30 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_31 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_32 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.615 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.615 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_33 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_34 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.670 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.670 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_35 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_36 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_37 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_38 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.775 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.775 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_39 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_40 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_41 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.855 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.855 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_42 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_43 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.911 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.911 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_44 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.939 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.939 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_45 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.967 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.967 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_46 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:52.994 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:52.994 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_47 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_48 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_49 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.078 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_50 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_51 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.134 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.134 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_52 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.162 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.162 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_53 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_54 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.215 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.215 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_55 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_56 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_57 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.298 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.298 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_58 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_59 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_60 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_61 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.411 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.411 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_62 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_63 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_64 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_65 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.523 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_66 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_67 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_68 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_69 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_70 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.653 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.653 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_71 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_72 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.710 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.710 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_73 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.738 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_74 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_75 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.795 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.795 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_76 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_77 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.851 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.851 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_78 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.879 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_79 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_80 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_81 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.962 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.962 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_82 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:53.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:53.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_83 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_84 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_85 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.065 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.065 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_86 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_87 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_88 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_89 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.180 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_90 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_91 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.236 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.236 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_92 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.264 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.264 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_93 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.292 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.292 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_94 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.319 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.319 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_95 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_96 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_97 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.394 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.394 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_98 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_99 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:462: TEST_divergent_2: for i in $(seq 1 $testobjects) 2026-02-13T09:41:54.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:464: TEST_divergent_2: rados -p test put existing_100 /tmp/tmp.WuVyKlVMjN 2026-02-13T09:41:54.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:41:54.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:467: TEST_divergent_2: wait_for_clean 2026-02-13T09:41:54.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:41:54.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:41:54.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:41:54.476 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:41:54.476 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:41:54.476 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:41:54.477 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:41:54.477 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:41:54.477 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:41:54.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:41:54.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:41:54.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:41:54.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:41:54.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:41:54.546 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:41:54.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:41:54.766 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:41:54.766 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:41:54.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:41:54.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:54.767 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:41:54.846 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836491 2026-02-13T09:41:54.846 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836491 2026-02-13T09:41:54.846 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491' 2026-02-13T09:41:54.846 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:54.846 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:41:54.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705674 2026-02-13T09:41:54.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705674 2026-02-13T09:41:54.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674' 2026-02-13T09:41:54.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:41:54.926 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:41:55.005 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-13T09:41:55.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-13T09:41:55.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836491 1-38654705674 2-55834574857' 2026-02-13T09:41:55.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:55.006 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836491 2026-02-13T09:41:55.006 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:55.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:41:55.008 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836491 2026-02-13T09:41:55.008 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:55.009 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836491 2026-02-13T09:41:55.010 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836491 2026-02-13T09:41:55.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836491' 2026-02-13T09:41:55.010 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:41:55.229 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836491 2026-02-13T09:41:55.229 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:41:56.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:41:56.231 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:41:56.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836491 -lt 21474836491 2026-02-13T09:41:56.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:56.453 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705674 2026-02-13T09:41:56.453 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:56.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:41:56.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705674 2026-02-13T09:41:56.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:56.456 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705674 2026-02-13T09:41:56.456 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705674' 2026-02-13T09:41:56.457 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705674 2026-02-13T09:41:56.457 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:41:56.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705674 2026-02-13T09:41:56.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:41:56.684 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-13T09:41:56.684 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:41:56.685 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:41:56.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574857 2026-02-13T09:41:56.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:41:56.687 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-13T09:41:56.688 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574857 2026-02-13T09:41:56.688 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-13T09:41:56.688 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:41:56.908 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-13T09:41:56.909 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:41:56.909 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:41:56.909 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:41:57.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:41:57.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:41:57.188 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:41:57.188 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:41:57.188 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:41:57.188 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:41:57.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:41:57.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:41:57.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:41:57.396 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:41:57.397 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:41:57.397 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:41:57.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:41:57.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:41:57.683 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:41:57.684 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: get_pg test existing_1 2026-02-13T09:41:57.684 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T09:41:57.685 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T09:41:57.685 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T09:41:57.685 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T09:41:57.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:469: TEST_divergent_2: local pgid=1.0 2026-02-13T09:41:57.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:472: TEST_divergent_2: echo 'blackholing osds 0 2' 2026-02-13T09:41:57.904 INFO:tasks.workunit.client.0.trial010.stdout:blackholing osds 0 2 2026-02-13T09:41:57.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:473: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:41:58.102 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:41:58.102 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T09:41:42.906558+0000 26'100 26:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:09:56.268948+0000 0 0 2026-02-13T09:41:58.102 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:41:58.102 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:41:58.103 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:41:58.112 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:41:58.113 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.0 2026-02-13T09:41:58.113 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:41:58.113 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:41:58.114 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:41:58.115 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:58.115 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:58.115 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:41:58.115 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-13T09:41:58.115 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T09:41:58.169 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:41:58.170 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:41:58.170 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:41:58.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:474: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:41:58.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: get_asok_path osd.2 2026-02-13T09:41:58.177 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:41:58.177 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:41:58.177 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:41:58.177 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:41:58.177 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:41:58.177 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:41:58.178 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: CEPH_ARGS= 2026-02-13T09:41:58.178 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:476: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T09:41:58.231 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:41:58.231 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:41:58.231 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:41:58.237 INFO:tasks.workunit.client.0.trial010.stdout:create new divergent objects 2026-02-13T09:41:58.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:480: TEST_divergent_2: echo 'create new divergent objects' 2026-02-13T09:41:58.237 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: seq 1 2 2026-02-13T09:41:58.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:41:58.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:481: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:41:58.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_1 2026-02-13T09:41:58.239 INFO:tasks.workunit.client.0.trial010.stdout:writing divergent objects 2026-02-13T09:41:58.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:486: TEST_divergent_2: echo 'writing divergent objects' 2026-02-13T09:41:58.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:483: TEST_divergent_2: rados -p test create newobject_2 2026-02-13T09:41:58.240 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: seq 1 2 2026-02-13T09:41:58.240 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T09:41:58.240 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:487: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T09:41:58.241 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_1 /tmp/tmp.gdb2r6WdO2 2026-02-13T09:41:58.241 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:492: TEST_divergent_2: echo 'remove divergent objects' 2026-02-13T09:41:58.241 INFO:tasks.workunit.client.0.trial010.stdout:remove divergent objects 2026-02-13T09:41:58.241 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:489: TEST_divergent_2: rados -p test put existing_2 /tmp/tmp.gdb2r6WdO2 2026-02-13T09:41:58.242 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: seq 1 2 2026-02-13T09:41:58.242 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T09:41:58.242 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 1 + 2 2026-02-13T09:41:58.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=3 2026-02-13T09:41:58.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:493: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T09:41:58.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_3 2026-02-13T09:41:58.245 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: expr 2 + 2 2026-02-13T09:41:58.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:495: TEST_divergent_2: rmi=4 2026-02-13T09:41:58.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:498: TEST_divergent_2: sleep 10 2026-02-13T09:41:58.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:496: TEST_divergent_2: rados -p test rm existing_4 2026-02-13T09:42:08.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:499: TEST_divergent_2: killall -9 rados 2026-02-13T09:42:08.297 INFO:tasks.workunit.client.0.trial010.stderr:rados: no process found 2026-02-13T09:42:08.297 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:502: TEST_divergent_2: echo 'killing all the osds' 2026-02-13T09:42:08.298 INFO:tasks.workunit.client.0.trial010.stdout:killing all the osds 2026-02-13T09:42:08.298 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:503: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:42:08.497 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:42:08.497 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-13T09:41:42.906558+0000 26'106 26:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:09:56.268948+0000 0 0 2026-02-13T09:42:08.497 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:42:08.497 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:42:08.497 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:42:08.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:504: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd 2026-02-13T09:42:08.506 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:42:08.507 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:42:08.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:42:08.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:42:08.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:42:08.615 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:42:08.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-13T09:42:08.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.0 2026-02-13T09:42:08.875 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:42:08.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-13T09:42:08.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.1 2026-02-13T09:42:09.161 INFO:tasks.workunit.client.0.trial010.stderr:osd.1 is already down. 2026-02-13T09:42:09.171 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:505: TEST_divergent_2: for i in $osds 2026-02-13T09:42:09.171 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:507: TEST_divergent_2: ceph osd down osd.2 2026-02-13T09:42:09.451 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already down. 2026-02-13T09:42:09.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:42:09.461 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.0 2026-02-13T09:42:09.724 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already out. 2026-02-13T09:42:09.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:509: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:42:09.734 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:511: TEST_divergent_2: ceph osd out osd.2 2026-02-13T09:42:10.008 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already out. 2026-02-13T09:42:10.018 INFO:tasks.workunit.client.0.trial010.stdout:bringing up non_divergent 0 2 2026-02-13T09:42:10.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:515: TEST_divergent_2: echo 'bringing up non_divergent 0 2' 2026-02-13T09:42:10.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:516: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:42:10.231 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:42:10.231 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-13T09:41:42.906558+0000 26'106 26:128 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:09:56.268948+0000 0 0 2026-02-13T09:42:10.231 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:42:10.232 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:42:10.232 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:42:10.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:42:10.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 0 2026-02-13T09:42:10.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:42:10.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:42:10.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:42:10.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:42:10.243 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:42:10.244 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:42:10.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:42:10.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:42:10.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:42:10.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:42:10.246 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:42:10.246 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:42:10.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:42:10.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:42:10.248 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T09:42:10.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:42:10.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:42:10.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:42:10.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:42:10.271 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:10.265+0000 7fcd1bd14a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:42:10.273 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:10.269+0000 7fcd1bd14a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:42:10.274 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:10.269+0000 7fcd1bd14a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:42:10.462 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:42:10.462 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:42:10.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:42:10.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:42:10.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:42:10.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:42:10.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:42:10.463 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:42:10.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:42:10.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:42:10.638 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:10.633+0000 7fcd1bd14a40 -1 Falling back to public interface 2026-02-13T09:42:10.687 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:42:11.266 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:11.261+0000 7fcd1bd14a40 -1 osd.0 26 log_to_monitors true 2026-02-13T09:42:11.688 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:42:11.688 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:42:11.689 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:42:11.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:42:11.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:42:11.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:42:11.900 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up out weight 0 up_from 33 up_thru 0 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/2188871179,v1:127.0.0.1:6801/2188871179] [v2:127.0.0.1:6802/2188871179,v1:127.0.0.1:6803/2188871179] exists,up 11c37136-8f50-40ec-8bba-e112620a13e3 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:517: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:519: TEST_divergent_2: activate_osd td/divergent-priors 2 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:42:11.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:42:11.905 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:42:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:42:11.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:42:11.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:42:11.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:42:11.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:42:11.907 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:42:11.908 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:42:11.908 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:42:11.908 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T09:42:11.908 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:42:11.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:42:11.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:42:11.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:42:11.924 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:11.917+0000 7f95c0ccaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:42:11.926 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:11.921+0000 7f95c0ccaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:42:11.927 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:11.921+0000 7f95c0ccaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:42:12.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:42:12.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:42:12.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:42:12.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:42:12.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:42:12.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:42:12.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:42:12.126 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:42:12.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:42:12.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:42:12.317 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:12.313+0000 7f95c0ccaa40 -1 Falling back to public interface 2026-02-13T09:42:12.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:42:12.912 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:42:12.905+0000 7f95c0ccaa40 -1 osd.2 26 log_to_monitors true 2026-02-13T09:42:13.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:42:13.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:42:13.349 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:42:13.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:42:13.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:42:13.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:42:13.557 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up out weight 0 up_from 36 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/266072202,v1:127.0.0.1:6811/266072202] [v2:127.0.0.1:6812/266072202,v1:127.0.0.1:6813/266072202] exists,up 35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197 2026-02-13T09:42:13.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:42:13.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:42:13.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:42:13.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:42:13.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.0 2026-02-13T09:42:13.802 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already in. 2026-02-13T09:42:13.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:521: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:42:13.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:523: TEST_divergent_2: ceph osd in osd.2 2026-02-13T09:42:14.106 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already in. 2026-02-13T09:42:14.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:42:14.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:526: TEST_divergent_2: wait_for_clean 2026-02-13T09:42:14.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:42:14.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:42:14.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:42:14.117 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:42:14.118 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:42:14.118 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:42:14.118 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:42:14.118 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:42:14.118 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:42:14.184 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:42:14.184 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:42:14.184 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:42:14.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:42:14.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:42:14.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:42:14.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:42:14.401 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:42:14.401 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:42:14.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:42:14.402 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:42:14.402 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:42:14.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920771 2026-02-13T09:42:14.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920771 2026-02-13T09:42:14.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771' 2026-02-13T09:42:14.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:42:14.482 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:42:14.543 INFO:tasks.workunit.client.0.trial010.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-13T09:42:14.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T09:42:14.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T09:42:14.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T09:42:14.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:42:14.546 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:42:14.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-13T09:42:14.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-13T09:42:14.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920771 2-154618822659' 2026-02-13T09:42:14.625 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:42:14.625 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920771 2026-02-13T09:42:14.626 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:42:14.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:42:14.627 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-141733920771 2026-02-13T09:42:14.627 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:42:14.629 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920771 2026-02-13T09:42:14.629 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 141733920771 2026-02-13T09:42:14.629 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 141733920771' 2026-02-13T09:42:14.629 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:42:14.848 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 141733920771 2026-02-13T09:42:14.849 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:42:15.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:42:15.850 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:42:16.064 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920771 -lt 141733920771 2026-02-13T09:42:16.065 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:42:16.065 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-154618822659 2026-02-13T09:42:16.065 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:42:16.066 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:42:16.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-154618822659 2026-02-13T09:42:16.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:42:16.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822659 2026-02-13T09:42:16.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 154618822659' 2026-02-13T09:42:16.069 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 154618822659 2026-02-13T09:42:16.069 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:42:16.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822659 -lt 154618822659 2026-02-13T09:42:16.283 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:42:16.283 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:16.283 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:16.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:42:16.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:16.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:16.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:16.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:16.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:16.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:16.565 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:16.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:16.772 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:16.773 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:16.773 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:17.050 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:17.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T09:42:17.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T09:42:17.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T09:42:17.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:17.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T09:42:17.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:17.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:17.152 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:17.152 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:17.152 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:17.152 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:17.153 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:17.153 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:17.362 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:17.362 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:17.363 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:17.363 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:17.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:17.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:17.644 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:17.644 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:17.644 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:17.644 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:17.644 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:17.644 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:17.645 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:17.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:17.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:17.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T09:42:17.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:17.926 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T09:42:18.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:18.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:18.127 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:18.127 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:18.127 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:18.127 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:18.128 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:18.129 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:18.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:18.335 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:18.335 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:18.335 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:18.626 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:18.626 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:18.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:18.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:18.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:18.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:18.627 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:18.627 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:18.628 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:18.913 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:18.913 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:18.914 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T09:42:18.914 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:18.914 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T09:42:19.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:19.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:19.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:19.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:19.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:19.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:19.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:19.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:19.529 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:19.530 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:19.530 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:19.530 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:19.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:19.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:19.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:19.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:19.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:19.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:19.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:19.815 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:19.815 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:20.109 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:20.109 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:20.109 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T09:42:20.109 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:20.110 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T09:42:20.910 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:20.910 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:20.911 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:20.911 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:20.911 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:20.911 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:20.911 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:20.911 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:21.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:21.127 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:21.127 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:21.127 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:21.417 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:21.418 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:21.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:21.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:21.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T09:42:21.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:21.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T09:42:23.311 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:23.312 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:23.313 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:23.313 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:23.313 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:23.313 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:23.313 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:23.313 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:23.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:23.531 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:23.531 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:23.531 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:23.824 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:23.825 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:24.112 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:24.112 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:24.112 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T09:42:24.113 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:24.113 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T09:42:27.313 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:27.313 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:27.314 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:27.314 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:27.314 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:27.314 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:27.314 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:27.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:27.527 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:27.527 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:27.527 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:27.528 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:27.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:27.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:27.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:27.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:27.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:27.804 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:27.804 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:27.804 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:27.804 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:28.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:28.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:28.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T09:42:28.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:28.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T09:42:34.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:34.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:34.496 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:34.497 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:34.497 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:34.497 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:34.497 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:34.497 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:34.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:34.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:34.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:34.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:34.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:34.998 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:34.998 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:34.998 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:34.998 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:34.998 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:34.998 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:34.999 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:34.999 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:35.279 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:35.279 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:35.279 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T09:42:35.279 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:35.279 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T09:42:42.580 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:42.580 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:42.581 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:42.581 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:42.581 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:42.581 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:42.582 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:42.582 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:42.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:42.799 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:42.800 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:42.800 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:43.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:43.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:43.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:43.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:43.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:43.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:43.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:43.091 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:43.091 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:43.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:43.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:43.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T09:42:43.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T09:42:43.656 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:42:43.656 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_fingerprint": "5231d507-13f7-483f-99a2-c0bfbe082f37", 2026-02-13T09:42:43.656 INFO:tasks.workunit.client.0.trial010.stdout: "version": "20.2.0-636-g3b40640f", 2026-02-13T09:42:43.656 INFO:tasks.workunit.client.0.trial010.stdout: "commit": "3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb", 2026-02-13T09:42:43.656 INFO:tasks.workunit.client.0.trial010.stdout: "timestamp": "2026-02-13T09:42:43.652286+0000", 2026-02-13T09:42:43.656 INFO:tasks.workunit.client.0.trial010.stdout: "tag": "", 2026-02-13T09:42:43.656 INFO:tasks.workunit.client.0.trial010.stdout: "health": { 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "status": "HEALTH_WARN", 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "checks": { 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "OSDMAP_FLAGS": { 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "count": 17 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [], 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.657 INFO:tasks.workunit.client.0.trial010.stdout: "OSD_DOWN": { 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: "message": "1 osds down", 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: "message": "osd.1 (root=default,host=trial010) is down" 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.658 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: "PG_DEGRADED": { 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.659 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "mutes": [] 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_first_committed": 1, 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_last_committed": 1, 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "monmap": { 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:42:43.660 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:41:30.893876Z", 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:41:30.893876Z", 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release": 20, 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release_name": "tentacle", 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "election_strategy": 1, 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "disallowed_leaders": "", 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": false, 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "tiebreaker_mon": "", 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "removed_ranks": "", 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "features": { 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "persistent": [ 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "kraken", 2026-02-13T09:42:43.661 INFO:tasks.workunit.client.0.trial010.stdout: "luminous", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "mimic", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap-prune", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "nautilus", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "octopus", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "pacific", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "elector-pinging", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "quincy", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "reef", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "squid", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "tentacle", 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "nvmeof_beacon_diff" 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.662 INFO:tasks.workunit.client.0.trial010.stdout: "optional": [] 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "mons": [ 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "rank": 0, 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "name": "a", 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115", 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 0 2026-02-13T09:42:43.663 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: "priority": 0, 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 0, 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: "crush_location": "{}" 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: "quorum": [ 2026-02-13T09:42:43.664 INFO:tasks.workunit.client.0.trial010.stdout: 0 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap": { 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 40, 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:41:30.998208+0000", 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:42:14.148533+0000", 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "last_up_change": "2026-02-13T09:42:13.064375+0000", 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "last_in_change": "2026-02-13T09:42:14.046348+0000", 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "flags_num": 5800384, 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "flags_set": [ 2026-02-13T09:42:43.665 INFO:tasks.workunit.client.0.trial010.stdout: "nodown", 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "noin", 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "noout", 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "pglog_hardlimit", 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snapdirs", 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "recovery_deletes", 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "sortbitwise" 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "crush_version": 9, 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T09:42:43.666 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_snapshot": "", 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "pool_max": 1, 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "max_osd": 3, 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "require_min_compat_client": "luminous", 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "min_compat_client": "jewel", 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "require_osd_release": "tentacle", 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "allow_crimson": false, 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "pools": [ 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "pool_name": "test", 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "create_time": "2026-02-13T09:41:42.735700+0000", 2026-02-13T09:42:43.667 INFO:tasks.workunit.client.0.trial010.stdout: "flags": 1, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "flags_names": "hashpspool", 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "size": 3, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "min_size": 2, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "crush_rule": 0, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_count": 0, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_target": 0, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "is_stretch_pool": false, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "object_hash": 2, 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "pg_autoscale_mode": "off", 2026-02-13T09:42:43.668 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num": 1, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num": 1, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num_target": 1, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_target": 1, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_pending": 1, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "last_pg_merge_meta": { 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "source_pgid": "0.0", 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "ready_epoch": 0, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_started": 0, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": 0, 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "source_version": "0'0", 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: "target_version": "0'0" 2026-02-13T09:42:43.669 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "last_change": "26", 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend": "0", 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "auid": 0, 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "snap_mode": "selfmanaged", 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "snap_seq": 0, 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "snap_epoch": 0, 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "pool_snaps": [], 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps": "[]", 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_bytes": 0, 2026-02-13T09:42:43.670 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_objects": 0, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "tiers": [], 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "tier_of": -1, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "read_tier": -1, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "write_tier": -1, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "cache_mode": "none", 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_bytes": 0, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_objects": 0, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_flush_age": 0, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_evict_age": 0, 2026-02-13T09:42:43.671 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profile": "", 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_params": { 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "type": "none" 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_period": 0, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_count": 0, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "use_gmt_hitset": true, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "min_read_recency_for_promote": 0, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "min_write_recency_for_promote": 0, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_search_last_n": 0, 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "grade_table": [], 2026-02-13T09:42:43.672 INFO:tasks.workunit.client.0.trial010.stdout: "stripe_width": 0, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "expected_num_objects": 0, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "fast_read": false, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "nonprimary_shards": "{}", 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "options": {}, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "application_metadata": {}, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "read_balance": { 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "score_type": "Fair distribution", 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "score_acting": 2.9900000095367432, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "score_stable": 2.9900000095367432, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_acting": 2, 2026-02-13T09:42:43.673 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_stable": 2, 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity_weighted": 1, 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity": 1, 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity_weighted": 1 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "osds": [ 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "11c37136-8f50-40ec-8bba-e112620a13e3", 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:42:43.674 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 5, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 33, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 39, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 27, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.675 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6800", 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6801", 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.676 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6802", 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6803", 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:42:43.677 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6806", 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6807", 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.678 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6804", 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6805", 2026-02-13T09:42:43.679 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6801/2188871179", 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6803/2188871179", 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2188871179", 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2188871179", 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.680 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "ecf85c02-d562-4877-83ef-3e5a28190370", 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "up": 0, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 0, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 0, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 9, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 20, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 28, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:42:43.681 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.682 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.683 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.684 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.685 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/4179701101", 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/4179701101", 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4179701101", 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4179701101", 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "exists" 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.686 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197", 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 13, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 36, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 0, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 29, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.687 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.688 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.689 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:42:43.690 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/266072202", 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/266072202", 2026-02-13T09:42:43.691 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/266072202", 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/266072202", 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "osd_xinfo": [ 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:42:08.816560+0000", 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:42:43.692 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:41:34.610256+0000", 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:42:09.101185+0000", 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:42:43.693 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:42:09.390772+0000", 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:41:40.856381+0000", 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap": [], 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_items": [], 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_primaries": [], 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "pg_temp": [], 2026-02-13T09:42:43.694 INFO:tasks.workunit.client.0.trial010.stdout: "primary_temp": [], 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "blocklist": {}, 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "range_blocklist": {}, 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profiles": { 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "default": { 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "m": "2", 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps_queue": [], 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "new_removed_snaps": [], 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "new_purged_snaps": [], 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "crush_node_flags": {}, 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "device_class_flags": {}, 2026-02-13T09:42:43.695 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": { 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_enabled": false, 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_bucket_count": 0, 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "degraded_stretch_mode": 0, 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "recovering_stretch_mode": 0, 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_bucket": 0 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "osd_metadata": [ 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6802/2188871179,v1:127.0.0.1:6803/2188871179]", 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:42:43.696 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:42:43.697 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:41:31.894321Z", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6800/2188871179,v1:127.0.0.1:6801/2188871179]", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2188871179,v1:127.0.0.1:6807/2188871179]", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2188871179,v1:127.0.0.1:6805/2188871179]", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:42:43.698 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/4179701101,v1:127.0.0.1:6813/4179701101]", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:42:43.699 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:42:43.700 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:41:35.546530Z", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/4179701101,v1:127.0.0.1:6811/4179701101]", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4179701101,v1:127.0.0.1:6817/4179701101]", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4179701101,v1:127.0.0.1:6815/4179701101]", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:42:43.701 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/266072202,v1:127.0.0.1:6813/266072202]", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:42:43.702 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:41:38.384506Z", 2026-02-13T09:42:43.703 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/266072202,v1:127.0.0.1:6811/266072202]", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/266072202,v1:127.0.0.1:6817/266072202]", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/266072202,v1:127.0.0.1:6815/266072202]", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:42:43.704 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_clean_epochs": { 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "min_last_epoch_clean": 0, 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": { 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "per_pool": [] 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "osd_epochs": [ 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 33 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 37 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.705 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_first_committed": 1, 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_last_committed": 40, 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "crushmap": { 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "devices": [ 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.0", 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.1", 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.2", 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "types": [ 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.706 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 0, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd" 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "name": "host" 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 2, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "name": "chassis" 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 3, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "name": "rack" 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 4, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "name": "row" 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 5, 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pdu" 2026-02-13T09:42:43.707 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 6, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pod" 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 7, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "name": "room" 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 8, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "name": "datacenter" 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 9, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "name": "zone" 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 10, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "name": "region" 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:42:43.708 INFO:tasks.workunit.client.0.trial010.stdout: "name": "root" 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "buckets": [ 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "id": -1, 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default", 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "id": -2, 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default~ssd", 2026-02-13T09:42:43.709 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010", 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:42:43.710 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010~ssd", 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:42:43.711 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "rules": [ 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 0, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "replicated_rule", 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.712 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_firstn", 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "tunables": { 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_tries": 0, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_fallback_tries": 0, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "choose_total_tries": 50, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_descend_once": 1, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_vary_r": 1, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_stable": 1, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "msr_descents": 100, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "msr_collision_tries": 100, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "straw_calc_version": 1, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "allowed_bucket_algs": 54, 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "profile": "jewel", 2026-02-13T09:42:43.713 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_tunables": 1, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "legacy_tunables": 0, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "minimum_required_version": "jewel", 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables": 1, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables2": 1, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "has_v2_rules": 0, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables3": 1, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "has_v3_rules": 0, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "has_v4_buckets": 1, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables5": 1, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "has_v5_rules": 0, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "has_msr_rules": 0 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "choose_args": {} 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "fsmap": { 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:42:43.714 INFO:tasks.workunit.client.0.trial010.stderr:report 3592633423 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "btime": "2026-02-13T09:41:30:997965+0000", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "default_fscid": -1, 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "compat": { 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "compat": {}, 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "ro_compat": {}, 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "incompat": { 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_1": "base v0.20", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_2": "client writeable ranges", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_4": "dir inode in separate object", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_8": "no anchor table", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_9": "file layout v2", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_10": "snaprealm v2", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_11": "minor log segments", 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "feature_flags": { 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "enable_multiple": true, 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "ever_enabled_multiple": true 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.715 INFO:tasks.workunit.client.0.trial010.stdout: "standbys": [], 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "filesystems": [] 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_first_committed": 1, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_last_committed": 1, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "auth": { 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 5, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_secrets": 3 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_active": 1, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_unknown": 0, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_osd": 3, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "pool_sum": { 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51200, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:42:43.716 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 100, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 100, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:42:43.717 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 16, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 16, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "up": 2, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 2, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 0 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum": { 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:42:43.718 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83848, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2064, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 26, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81701, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488952, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036686848, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2113536, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 421168, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 26700, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83662772 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:42:43.719 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum_by_class": { 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "ssd": { 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83848, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2064, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 26, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81701, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488952, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036686848, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2113536, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 421168, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 26700, 2026-02-13T09:42:43.720 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83662772 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "pool_stats": [ 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51200, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:42:43.721 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 100, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 100, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:42:43.722 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 1220608, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 153552, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 16, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 16, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "up": 2, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 2, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 3 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "osd_stats": [ 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 141733920777 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 38654705677 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.723 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 154618822665 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_state": [ 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded", 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num": 1 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "pool_pg_unavailable_map": [ 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": "1", 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "pgs": [] 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_osd": [ 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 1, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:42:43.724 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 0, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": [ 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": {} 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "servicemap": { 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 3, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:42:39.394134+0000", 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "services": { 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "osd": { 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "daemons": { 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "summary": "", 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "0": { 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "2": { 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.725 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_first_committed": 1, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_last_committed": 37, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "logm_first_committed": 1, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "logm_last_committed": 220, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "paxos": { 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 307, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "last_pn": 0, 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: "accepted_pn": 0 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: expr 2 + 2 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:529: TEST_divergent_2: objname=existing_4 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stdout:writing non-divergent object existing_4 2026-02-13T09:42:43.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:530: TEST_divergent_2: echo 'writing non-divergent object existing_4' 2026-02-13T09:42:43.727 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:531: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:42:43.870 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:42:43.870 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:42:14.152095+0000 26'100 40:131 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:08:21.918498+0000 0 0 2026-02-13T09:42:43.870 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:42:43.870 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:42:43.870 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:42:43.879 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:532: TEST_divergent_2: rados -p test put existing_4 /tmp/tmp.gdb2r6WdO2 2026-02-13T09:42:43.910 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:533: TEST_divergent_2: rm -f /tmp/tmp.gdb2r6WdO2 2026-02-13T09:42:43.911 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:42:43.912 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:535: TEST_divergent_2: wait_for_clean 2026-02-13T09:42:43.912 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:42:43.912 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:42:43.912 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:42:43.913 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:42:43.913 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:42:43.913 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:42:43.913 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:42:43.913 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:42:43.913 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:42:43.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:42:43.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:42:43.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:42:43.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:42:43.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:42:43.984 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:42:44.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:42:44.199 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:42:44.199 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:42:44.199 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:42:44.199 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:42:44.199 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:42:44.280 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=141733920779 2026-02-13T09:42:44.280 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 141733920779 2026-02-13T09:42:44.280 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920779' 2026-02-13T09:42:44.280 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:42:44.280 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:42:44.340 INFO:tasks.workunit.client.0.trial010.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-13T09:42:44.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T09:42:44.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T09:42:44.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T09:42:44.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:42:44.342 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:42:44.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822667 2026-02-13T09:42:44.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822667 2026-02-13T09:42:44.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-141733920779 2-154618822667' 2026-02-13T09:42:44.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:42:44.422 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-141733920779 2026-02-13T09:42:44.422 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:42:44.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:42:44.424 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-141733920779 2026-02-13T09:42:44.424 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:42:44.425 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=141733920779 2026-02-13T09:42:44.425 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 141733920779 2026-02-13T09:42:44.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 141733920779' 2026-02-13T09:42:44.426 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:42:44.636 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920777 -lt 141733920779 2026-02-13T09:42:44.636 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:42:45.637 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:42:45.638 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:42:45.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 141733920779 -lt 141733920779 2026-02-13T09:42:45.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:42:45.860 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-154618822667 2026-02-13T09:42:45.860 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:42:45.861 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:42:45.862 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-154618822667 2026-02-13T09:42:45.862 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:42:45.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822667 2026-02-13T09:42:45.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 154618822667' 2026-02-13T09:42:45.863 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 154618822667 2026-02-13T09:42:45.864 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:42:46.083 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822667 -lt 154618822667 2026-02-13T09:42:46.084 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:42:46.084 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:46.084 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:46.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:42:46.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:46.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:46.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:46.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:46.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:46.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:46.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:46.590 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:46.591 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:46.591 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:46.591 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:46.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:46.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T09:42:46.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T09:42:46.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T09:42:46.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:46.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T09:42:46.981 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:46.981 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:46.982 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:46.982 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:46.982 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:46.982 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:46.982 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:46.982 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:47.201 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:47.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:47.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:47.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:47.489 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:47.489 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:47.489 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:47.489 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:47.489 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:47.489 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:47.489 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:47.490 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:47.490 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:47.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:47.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:47.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T09:42:47.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:47.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T09:42:47.976 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:47.977 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:47.977 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:47.977 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:47.977 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:47.978 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:47.978 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:47.978 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:48.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:48.188 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:48.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:48.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:48.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:48.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:48.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:48.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:48.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:48.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:48.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:48.469 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:48.469 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:48.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:48.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:48.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T09:42:48.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:48.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T09:42:49.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:49.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:49.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:49.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:49.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:49.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:49.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:49.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:49.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:49.369 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:49.370 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:49.370 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:49.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:49.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:49.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:49.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:49.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:49.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:49.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:49.651 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:49.652 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:49.929 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:49.929 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:49.929 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T09:42:49.929 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:49.929 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T09:42:50.730 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:50.730 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:50.731 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:50.731 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:50.731 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:50.731 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:50.731 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:50.731 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:50.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:50.942 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:50.942 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:50.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:51.228 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:51.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:51.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:51.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T09:42:51.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:51.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T09:42:53.105 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:53.106 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:53.107 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:53.107 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:53.107 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:53.107 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:53.107 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:53.107 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:53.318 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:53.319 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:53.319 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:53.319 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:53.598 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:53.874 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:53.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:53.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T09:42:53.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:53.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T09:42:57.075 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:42:57.076 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:42:57.076 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:42:57.077 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:42:57.077 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:42:57.077 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:42:57.077 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:42:57.077 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:42:57.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:42:57.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:42:57.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:42:57.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:42:57.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:42:57.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:42:57.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:42:57.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:42:57.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T09:42:57.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:42:57.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T09:43:04.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:43:04.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:43:04.246 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:43:04.246 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:43:04.246 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:43:04.246 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:43:04.247 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:43:04.247 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:43:04.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:43:04.454 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:43:04.454 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:43:04.454 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:43:04.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:43:04.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:43:04.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:43:04.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:43:04.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:43:04.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:43:04.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:43:04.738 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:43:04.738 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:43:05.028 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:43:05.028 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:43:05.028 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T09:43:05.028 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:43:05.028 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T09:43:12.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:43:12.329 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:43:12.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:43:12.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:43:12.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:43:12.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:43:12.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:43:12.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:43:12.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:43:12.545 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:43:12.545 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:43:12.545 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:43:12.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:43:12.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:43:12.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:43:12.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:43:12.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:43:12.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:43:12.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:43:12.835 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:43:12.835 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:43:13.119 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:43:13.119 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:43:13.119 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T09:43:13.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_fingerprint": "5231d507-13f7-483f-99a2-c0bfbe082f37", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "version": "20.2.0-636-g3b40640f", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "commit": "3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "timestamp": "2026-02-13T09:43:13.387705+0000", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "tag": "", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "health": { 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "status": "HEALTH_WARN", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "checks": { 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "OSDMAP_FLAGS": { 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "count": 17 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [], 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "OSD_DOWN": { 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "message": "1 osds down", 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:43:13.390 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "message": "osd.1 (root=default,host=trial010) is down" 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "PG_DEGRADED": { 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 1 pg degraded", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "mutes": [] 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_first_committed": 1, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_last_committed": 1, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "monmap": { 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:41:30.893876Z", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:41:30.893876Z", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release": 20, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release_name": "tentacle", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "election_strategy": 1, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "disallowed_leaders": "", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": false, 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "tiebreaker_mon": "", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "removed_ranks": "", 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "features": { 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "persistent": [ 2026-02-13T09:43:13.391 INFO:tasks.workunit.client.0.trial010.stdout: "kraken", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "luminous", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "mimic", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap-prune", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "nautilus", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "octopus", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "pacific", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "elector-pinging", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "quincy", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "reef", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "squid", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "tentacle", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "nvmeof_beacon_diff" 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "optional": [] 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "mons": [ 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "rank": 0, 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "name": "a", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 0 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "priority": 0, 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 0, 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "crush_location": "{}" 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "quorum": [ 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: 0 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.392 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap": { 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 40, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:41:30.998208+0000", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:42:14.148533+0000", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "last_up_change": "2026-02-13T09:42:13.064375+0000", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "last_in_change": "2026-02-13T09:42:14.046348+0000", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "flags_num": 5800384, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "flags_set": [ 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "nodown", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "noin", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "noout", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "pglog_hardlimit", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snapdirs", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "recovery_deletes", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "sortbitwise" 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "crush_version": 9, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_snapshot": "", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "pool_max": 1, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "max_osd": 3, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "require_min_compat_client": "luminous", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "min_compat_client": "jewel", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "require_osd_release": "tentacle", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "allow_crimson": false, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "pools": [ 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "pool_name": "test", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "create_time": "2026-02-13T09:41:42.735700+0000", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "flags": 1, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "flags_names": "hashpspool", 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "size": 3, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "min_size": 2, 2026-02-13T09:43:13.393 INFO:tasks.workunit.client.0.trial010.stdout: "crush_rule": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_count": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_target": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "is_stretch_pool": false, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "object_hash": 2, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "pg_autoscale_mode": "off", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num": 1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num": 1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num_target": 1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_target": 1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_pending": 1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "last_pg_merge_meta": { 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "source_pgid": "0.0", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "ready_epoch": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_started": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "source_version": "0'0", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "target_version": "0'0" 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "last_change": "26", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend": "0", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "auid": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "snap_mode": "selfmanaged", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "snap_seq": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "snap_epoch": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "pool_snaps": [], 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps": "[]", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_bytes": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_objects": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "tiers": [], 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "tier_of": -1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "read_tier": -1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "write_tier": -1, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "cache_mode": "none", 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_bytes": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_objects": 0, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T09:43:13.394 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_flush_age": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_evict_age": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profile": "", 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_params": { 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "type": "none" 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_period": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_count": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "use_gmt_hitset": true, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "min_read_recency_for_promote": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "min_write_recency_for_promote": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_search_last_n": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "grade_table": [], 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "stripe_width": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "expected_num_objects": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "fast_read": false, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "nonprimary_shards": "{}", 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "options": {}, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "application_metadata": {}, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "read_balance": { 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "score_type": "Fair distribution", 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "score_acting": 2.9900000095367432, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "score_stable": 2.9900000095367432, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_acting": 2, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_stable": 2, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity_weighted": 1, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity": 1, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity_weighted": 1 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "osds": [ 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "11c37136-8f50-40ec-8bba-e112620a13e3", 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:43:13.395 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 5, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 33, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 39, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 27, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6800", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6801", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6802", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6803", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.396 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6806", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6807", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6804", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6805", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2188871179 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6801/2188871179", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6803/2188871179", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2188871179", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2188871179", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "ecf85c02-d562-4877-83ef-3e5a28190370", 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "up": 0, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:43:13.397 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 0, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 0, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 9, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 20, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 28, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.398 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 4179701101 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/4179701101", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/4179701101", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/4179701101", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/4179701101", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "exists" 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197", 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:43:13.399 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 13, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 36, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 0, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 29, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.400 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 266072202 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/266072202", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/266072202", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/266072202", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/266072202", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "osd_xinfo": [ 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:42:08.816560+0000", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:41:34.610256+0000", 2026-02-13T09:43:13.401 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:42:09.101185+0000", 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:42:09.390772+0000", 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:41:40.856381+0000", 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap": [], 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_items": [], 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_primaries": [], 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "pg_temp": [], 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "primary_temp": [], 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "blocklist": {}, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "range_blocklist": {}, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profiles": { 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "default": { 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "m": "2", 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps_queue": [], 2026-02-13T09:43:13.402 INFO:tasks.workunit.client.0.trial010.stdout: "new_removed_snaps": [], 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "new_purged_snaps": [], 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "crush_node_flags": {}, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "device_class_flags": {}, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": { 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_enabled": false, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_bucket_count": 0, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "degraded_stretch_mode": 0, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "recovering_stretch_mode": 0, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_bucket": 0 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "osd_metadata": [ 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6802/2188871179,v1:127.0.0.1:6803/2188871179]", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:43:13.403 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:41:31.894321Z", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6800/2188871179,v1:127.0.0.1:6801/2188871179]", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2188871179,v1:127.0.0.1:6807/2188871179]", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2188871179,v1:127.0.0.1:6805/2188871179]", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/4179701101,v1:127.0.0.1:6813/4179701101]", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:43:13.404 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:41:35.546530Z", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/4179701101,v1:127.0.0.1:6811/4179701101]", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/4179701101,v1:127.0.0.1:6817/4179701101]", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/4179701101,v1:127.0.0.1:6815/4179701101]", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T09:43:13.405 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/266072202,v1:127.0.0.1:6813/266072202]", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:41:38.384506Z", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:43:13.406 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/266072202,v1:127.0.0.1:6811/266072202]", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/266072202,v1:127.0.0.1:6817/266072202]", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/266072202,v1:127.0.0.1:6815/266072202]", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_clean_epochs": { 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "min_last_epoch_clean": 0, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": { 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "per_pool": [] 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "osd_epochs": [ 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 33 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 37 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_first_committed": 1, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_last_committed": 40, 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "crushmap": { 2026-02-13T09:43:13.407 INFO:tasks.workunit.client.0.trial010.stdout: "devices": [ 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.0", 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.1", 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.2", 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "types": [ 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 0, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "host" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 2, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "chassis" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 3, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "rack" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 4, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "name": "row" 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.408 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 5, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pdu" 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 6, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pod" 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 7, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "room" 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 8, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "datacenter" 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 9, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "zone" 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 10, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "region" 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "root" 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "buckets": [ 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "id": -1, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default", 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:43:13.409 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "id": -2, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default~ssd", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.410 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010~ssd", 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "rules": [ 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 0, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "replicated_rule", 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:43:13.411 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_firstn", 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "tunables": { 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_tries": 0, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_fallback_tries": 0, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "choose_total_tries": 50, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_descend_once": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_vary_r": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_stable": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "msr_descents": 100, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "msr_collision_tries": 100, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "straw_calc_version": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "allowed_bucket_algs": 54, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "profile": "jewel", 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_tunables": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "legacy_tunables": 0, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "minimum_required_version": "jewel", 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables2": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "has_v2_rules": 0, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables3": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "has_v3_rules": 0, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "has_v4_buckets": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables5": 1, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "has_v5_rules": 0, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "has_msr_rules": 0 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "choose_args": {} 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.412 INFO:tasks.workunit.client.0.trial010.stdout: "fsmap": { 2026-02-13T09:43:13.413 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:43:13.413 INFO:tasks.workunit.client.0.trial010.stderr:report 1261401389 2026-02-13T09:43:13.414 INFO:tasks.workunit.client.0.trial010.stdout: "btime": "2026-02-13T09:41:30:997965+0000", 2026-02-13T09:43:13.414 INFO:tasks.workunit.client.0.trial010.stdout: "default_fscid": -1, 2026-02-13T09:43:13.414 INFO:tasks.workunit.client.0.trial010.stdout: "compat": { 2026-02-13T09:43:13.414 INFO:tasks.workunit.client.0.trial010.stdout: "compat": {}, 2026-02-13T09:43:13.414 INFO:tasks.workunit.client.0.trial010.stdout: "ro_compat": {}, 2026-02-13T09:43:13.414 INFO:tasks.workunit.client.0.trial010.stdout: "incompat": { 2026-02-13T09:43:13.414 INFO:tasks.workunit.client.0.trial010.stdout: "feature_1": "base v0.20", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_2": "client writeable ranges", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_4": "dir inode in separate object", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_8": "no anchor table", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_9": "file layout v2", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_10": "snaprealm v2", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_11": "minor log segments", 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "feature_flags": { 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "enable_multiple": true, 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "ever_enabled_multiple": true 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "standbys": [], 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "filesystems": [] 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_first_committed": 1, 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_last_committed": 1, 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "auth": { 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:43:13.415 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 5, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_secrets": 3 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_active": 1, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_unknown": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_osd": 3, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "pool_sum": { 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51688, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:43:13.416 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:43:13.417 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 17, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 17, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "up": 2, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 2, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 0 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum": { 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83848, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2064, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 26, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81701, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488952, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036686848, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2113536, 2026-02-13T09:43:13.418 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 422144, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 26700, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83662772 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum_by_class": { 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "ssd": { 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:43:13.419 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83848, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2064, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 26, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81701, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488952, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036686848, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2113536, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 422144, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 26700, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83662772 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:43:13.420 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "pool_stats": [ 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51688, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:43:13.421 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 1220608, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 154528, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:43:13.422 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 17, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 17, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "up": 2, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 2, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 3 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "osd_stats": [ 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 141733920785 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 38654705677 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 154618822672 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_state": [ 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded", 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "num": 1 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: "pool_pg_unavailable_map": [ 2026-02-13T09:43:13.423 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": "1", 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "pgs": [] 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_osd": [ 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 1, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 0, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": [ 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": {} 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "servicemap": { 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 4, 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:43:11.397781+0000", 2026-02-13T09:43:13.424 INFO:tasks.workunit.client.0.trial010.stdout: "services": { 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "osd": { 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "daemons": { 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "summary": "", 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "2": { 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_first_committed": 1, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_last_committed": 51, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "logm_first_committed": 1, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "logm_last_committed": 283, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "paxos": { 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 384, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "last_pn": 0, 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: "accepted_pn": 0 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:43:13.425 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T09:43:13.426 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery 2026-02-13T09:43:13.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:538: TEST_divergent_2: echo 'delay recovery' 2026-02-13T09:43:13.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:539: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:13.601 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:13.601 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:42:14.152095+0000 40'101 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:08:21.918498+0000 0 0 2026-02-13T09:43:13.601 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:13.601 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:13.601 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:13.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:43:13.610 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.0 2026-02-13T09:43:13.610 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:43:13.610 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:43:13.610 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:43:13.610 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:13.610 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:13.610 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:43:13.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-13T09:43:13.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T09:43:13.667 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:43:13.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:540: TEST_divergent_2: for i in $non_divergent 2026-02-13T09:43:13.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: get_asok_path osd.2 2026-02-13T09:43:13.674 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:43:13.674 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:43:13.674 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:43:13.674 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:13.674 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:13.674 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:43:13.675 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: CEPH_ARGS= 2026-02-13T09:43:13.675 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:542: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T09:43:13.727 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:43:13.732 INFO:tasks.workunit.client.0.trial010.stdout:revive divergent 1 2026-02-13T09:43:13.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:546: TEST_divergent_2: echo 'revive divergent 1' 2026-02-13T09:43:13.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:547: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:13.945 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:13.945 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:42:14.152095+0000 40'101 40:132 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:08:21.918498+0000 0 0 2026-02-13T09:43:13.945 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:13.946 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:13.946 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:13.954 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:548: TEST_divergent_2: ceph osd set noup 2026-02-13T09:43:14.281 INFO:tasks.workunit.client.0.trial010.stderr:noup is set 2026-02-13T09:43:14.299 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:549: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-13T09:43:14.299 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:43:14.299 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:43:14.299 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:43:14.299 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:43:14.299 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:43:14.300 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:43:14.301 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:43:14.301 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:14.301 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:14.301 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:14.302 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:14.302 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:43:14.302 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:43:14.302 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:43:14.303 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:43:14.304 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:43:14.304 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:43:14.305 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:43:14.305 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:43:14.305 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:43:14.305 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:43:14.305 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:43:14.328 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:14.321+0000 7f0922329a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:14.329 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:14.321+0000 7f0922329a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:14.330 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:14.321+0000 7f0922329a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:14.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T09:43:14.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:550: TEST_divergent_2: sleep 5 2026-02-13T09:43:14.661 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:14.653+0000 7f0922329a40 -1 Falling back to public interface 2026-02-13T09:43:15.265 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:15.257+0000 7f0922329a40 -1 osd.1 26 log_to_monitors true 2026-02-13T09:43:19.525 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery divergent 2026-02-13T09:43:19.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:552: TEST_divergent_2: echo 'delay recovery divergent' 2026-02-13T09:43:19.526 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:553: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:19.721 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:19.721 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51688 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:42:14.152095+0000 40'101 43:138 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:08:21.918498+0000 0 0 2026-02-13T09:43:19.721 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:19.721 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:19.721 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:19.730 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: get_asok_path osd.1 2026-02-13T09:43:19.730 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:43:19.730 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:43:19.730 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:43:19.730 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:19.730 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:19.731 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:43:19.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: CEPH_ARGS= 2026-02-13T09:43:19.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:554: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T09:43:19.786 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:43:19.792 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:556: TEST_divergent_2: ceph osd unset noup 2026-02-13T09:43:20.112 INFO:tasks.workunit.client.0.trial010.stderr:noup is unset 2026-02-13T09:43:20.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:558: TEST_divergent_2: wait_for_osd up 0 2026-02-13T09:43:20.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:20.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:43:20.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:20.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:20.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:20.125 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:20.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:20.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:20.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:43:20.342 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 33 up_thru 39 down_at 27 last_clean_interval [5,26) [v2:127.0.0.1:6800/2188871179,v1:127.0.0.1:6801/2188871179] [v2:127.0.0.1:6802/2188871179,v1:127.0.0.1:6803/2188871179] exists,up 11c37136-8f50-40ec-8bba-e112620a13e3 2026-02-13T09:43:20.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:20.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:20.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:20.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:559: TEST_divergent_2: wait_for_osd up 1 2026-02-13T09:43:20.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:20.344 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:43:20.344 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:20.344 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:20.344 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:20.344 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:20.344 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:20.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:20.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:43:20.555 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/1636699692,v1:127.0.0.1:6819/1636699692] [v2:127.0.0.1:6820/1636699692,v1:127.0.0.1:6821/1636699692] exists,up ecf85c02-d562-4877-83ef-3e5a28190370 2026-02-13T09:43:20.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:20.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:20.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:20.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:560: TEST_divergent_2: wait_for_osd up 2 2026-02-13T09:43:20.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:20.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:43:20.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:20.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:20.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:20.557 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:20.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:20.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:20.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:43:20.768 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 36 up_thru 0 down_at 29 last_clean_interval [13,26) [v2:127.0.0.1:6810/266072202,v1:127.0.0.1:6811/266072202] [v2:127.0.0.1:6812/266072202,v1:127.0.0.1:6813/266072202] exists,up 35a5caf2-c1e9-4e7c-bf4f-ca1c2e458197 2026-02-13T09:43:20.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:20.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:20.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:20.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:562: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:20.967 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:20.967 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-13T09:43:20.214474+0000 40'101 46:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:43:20.967 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:20.967 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:20.968 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:20.976 INFO:tasks.workunit.client.0.trial010.stdout:wait for peering 2026-02-13T09:43:20.976 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:563: TEST_divergent_2: echo 'wait for peering' 2026-02-13T09:43:20.976 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:564: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:21.195 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:21.195 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-13T09:43:20.214474+0000 40'101 46:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:43:21.196 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:21.196 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:21.196 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:21.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:565: TEST_divergent_2: rados -p test put foo /tmp/tmp.WuVyKlVMjN 2026-02-13T09:43:21.227 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:566: TEST_divergent_2: rm -f /tmp/tmp.WuVyKlVMjN 2026-02-13T09:43:21.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:570: TEST_divergent_2: echo 'killing divergent 1' 2026-02-13T09:43:21.228 INFO:tasks.workunit.client.0.trial010.stdout:killing divergent 1 2026-02-13T09:43:21.229 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:571: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:21.437 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:21.437 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-13T09:43:20.214474+0000 40'101 46:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:43:21.437 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:21.437 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:21.438 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:21.448 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:572: TEST_divergent_2: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T09:43:21.449 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:43:21.449 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:43:21.449 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:43:21.449 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:43:21.449 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:43:21.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:43:21.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:575: TEST_divergent_2: expfile=td/divergent-priors/exp.16079.out 2026-02-13T09:43:21.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:576: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16079.out 2026-02-13T09:43:21.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T09:43:21.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T09:43:21.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T09:43:21.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T09:43:21.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T09:43:21.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16079.out 2026-02-13T09:43:21.744 INFO:tasks.workunit.client.0.trial010.stderr:Exporting 1.0 info 1.0( v 47'102 lc 0'0 (26'90,47'102] local-lis/les=45/46 n=101 ec=20/20 lis/c=45/20 les/c/f=46/21/0 sis=45) 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:091f9f1d:::existing_94:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:0a865a93:::existing_54:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:0fed513c:::existing_41:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:13b9e0b8:::existing_92:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:169157fa:::existing_81:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:17731382:::existing_58:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:18a45a39:::existing_43:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:1c160f01:::existing_66:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:1dd6c249:::existing_97:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:227e0c77:::existing_7:head# 2026-02-13T09:43:21.750 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:23e1b063:::existing_59:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:28566edb:::existing_78:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:2a101182:::existing_20:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:2d1519da:::existing_96:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:3078b87a:::existing_86:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:30bde01b:::existing_15:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:317a7e19:::existing_56:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:38b9c7fa:::existing_33:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:3e16d84b:::existing_48:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:45fe8203:::existing_75:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:4e82c9ba:::existing_50:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:5298dcdb:::existing_57:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:52ebaa44:::existing_32:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:53588912:::existing_9:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:5b7e2de6:::existing_84:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:5da0255c:::existing_13:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:5da2dab8:::existing_53:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:5ee3514b:::existing_30:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:602f83fe:::foo:head# 2026-02-13T09:43:21.751 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:60426cc7:::existing_62:head# 2026-02-13T09:43:21.752 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:628918ca:::existing_79:head# 2026-02-13T09:43:21.755 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:63f8ab2d:::existing_77:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:67e1780f:::existing_27:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:68143ca1:::existing_71:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:6bac9509:::existing_29:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:6bbec798:::existing_45:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:6cb23a40:::existing_65:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:7055ec5e:::existing_83:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:70a54e2b:::existing_87:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:750ace21:::existing_19:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:78623b1d:::existing_6:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:79881152:::existing_63:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:7a80c0d5:::existing_99:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:81490677:::existing_76:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:85ec8e5d:::existing_85:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:8e2abbf0:::existing_49:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:8ee0fe0f:::existing_52:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:923c5d4d:::existing_5:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:92731e71:::existing_89:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:928205cf:::existing_82:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:93be2267:::existing_24:head# 2026-02-13T09:43:21.756 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:99ceda2c:::existing_44:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:9dd917ee:::existing_26:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:a28805a6:::existing_72:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:a294a8f6:::existing_16:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:a2f5473a:::existing_42:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:a504a533:::existing_90:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:a691337e:::existing_61:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:a6e8d7ac:::existing_28:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:a9fde86e:::existing_18:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:aa309faa:::existing_68:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:ae40b0ed:::existing_31:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:b279b1fe:::existing_10:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:b343e277:::existing_88:head# 2026-02-13T09:43:21.757 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:b7130e90:::existing_80:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:bc6f7309:::existing_70:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:be8489b7:::existing_38:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:beb4e5e3:::existing_47:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:bebec877:::existing_74:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:c04347d8:::existing_60:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:c156033e:::existing_100:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:c19f5a8e:::existing_8:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:c3e6ebe4:::existing_17:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:c6c5a7c2:::existing_39:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:cc1d0abf:::existing_95:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:ccb3865b:::existing_73:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:cd84e19e:::existing_40:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:d2cd64ce:::existing_37:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:d41a25c9:::existing_22:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:d7f088da:::existing_91:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:d9cbd1d6:::existing_64:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:dcc4ff82:::existing_98:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:dd677bd3:::existing_35:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:dd6d90e7:::existing_46:head# 2026-02-13T09:43:21.761 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:e0e22077:::existing_21:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:e255b710:::existing_55:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:eff1d5db:::existing_14:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:f1b156bf:::existing_23:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:f5ce4199:::existing_34:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:f6809456:::existing_11:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:f699a2a9:::existing_67:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:f9baac43:::existing_25:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:fb76688e:::existing_51:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:fbb92eec:::existing_69:head# 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Export successful 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stdout: marking collection for removal 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stdout:setting '_remove' omap key 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-13T09:43:21.762 INFO:tasks.workunit.client.0.trial010.stderr:Remove successful 2026-02-13T09:43:21.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:577: TEST_divergent_2: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16079.out 2026-02-13T09:43:21.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T09:43:21.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T09:43:21.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T09:43:21.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T09:43:21.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T09:43:21.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16079.out 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:get_pg_num_history pg_num_history pg_num_history(e47 pg_nums {1={20=1}} deleted_pools ) 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Importing pgid 1.0 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:091f9f1d:::existing_94:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:0a865a93:::existing_54:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:0fed513c:::existing_41:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:13b9e0b8:::existing_92:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:169157fa:::existing_81:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:17731382:::existing_58:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:18a45a39:::existing_43:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:1c160f01:::existing_66:head# 2026-02-13T09:43:22.033 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:1dd6c249:::existing_97:head# 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:227e0c77:::existing_7:head# 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:23e1b063:::existing_59:head# 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:28566edb:::existing_78:head# 2026-02-13T09:43:22.034 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:2a101182:::existing_20:head# 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:2d1519da:::existing_96:head# 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:3078b87a:::existing_86:head# 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:30bde01b:::existing_15:head# 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:317a7e19:::existing_56:head# 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:38b9c7fa:::existing_33:head# 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:3e16d84b:::existing_48:head# 2026-02-13T09:43:22.035 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:45fe8203:::existing_75:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:4e82c9ba:::existing_50:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:5298dcdb:::existing_57:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:52ebaa44:::existing_32:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:53588912:::existing_9:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:5b7e2de6:::existing_84:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:5da0255c:::existing_13:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:5da2dab8:::existing_53:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:5ee3514b:::existing_30:head# 2026-02-13T09:43:22.036 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:602f83fe:::foo:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:60426cc7:::existing_62:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:628918ca:::existing_79:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:63f8ab2d:::existing_77:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:67e1780f:::existing_27:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:68143ca1:::existing_71:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:6bac9509:::existing_29:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:6bbec798:::existing_45:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:6cb23a40:::existing_65:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:7055ec5e:::existing_83:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:70a54e2b:::existing_87:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:750ace21:::existing_19:head# 2026-02-13T09:43:22.037 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:78623b1d:::existing_6:head# 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:79881152:::existing_63:head# 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:7a80c0d5:::existing_99:head# 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:81490677:::existing_76:head# 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:85ec8e5d:::existing_85:head# 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.038 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:8e2abbf0:::existing_49:head# 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:8ee0fe0f:::existing_52:head# 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:923c5d4d:::existing_5:head# 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:92731e71:::existing_89:head# 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:928205cf:::existing_82:head# 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:93be2267:::existing_24:head# 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:99ceda2c:::existing_44:head# 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.039 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:9dd917ee:::existing_26:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:a28805a6:::existing_72:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:a294a8f6:::existing_16:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:a2f5473a:::existing_42:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:a504a533:::existing_90:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:a691337e:::existing_61:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:a6e8d7ac:::existing_28:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:a9fde86e:::existing_18:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:aa309faa:::existing_68:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:ae40b0ed:::existing_31:head# 2026-02-13T09:43:22.040 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:b279b1fe:::existing_10:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:b343e277:::existing_88:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:b7130e90:::existing_80:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:bc6f7309:::existing_70:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:be8489b7:::existing_38:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:beb4e5e3:::existing_47:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:bebec877:::existing_74:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:c04347d8:::existing_60:head# 2026-02-13T09:43:22.041 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:c156033e:::existing_100:head# 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:c19f5a8e:::existing_8:head# 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:c3e6ebe4:::existing_17:head# 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:c6c5a7c2:::existing_39:head# 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:cc1d0abf:::existing_95:head# 2026-02-13T09:43:22.042 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:ccb3865b:::existing_73:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:cd84e19e:::existing_40:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:d2cd64ce:::existing_37:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:d41a25c9:::existing_22:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:d7f088da:::existing_91:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:d9cbd1d6:::existing_64:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:dcc4ff82:::existing_98:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:dd677bd3:::existing_35:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:dd6d90e7:::existing_46:head# 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.043 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:e0e22077:::existing_21:head# 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:e255b710:::existing_55:head# 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:eff1d5db:::existing_14:head# 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:f1b156bf:::existing_23:head# 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:f5ce4199:::existing_34:head# 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:f6809456:::existing_11:head# 2026-02-13T09:43:22.044 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:f699a2a9:::existing_67:head# 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:f9baac43:::existing_25:head# 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:fb76688e:::existing_51:head# 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:fbb92eec:::existing_69:head# 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:write_pg epoch 47 info 1.0( v 47'102 lc 0'0 (26'90,47'102] local-lis/les=45/46 n=101 ec=20/20 lis/c=45/20 les/c/f=46/21/0 sis=45) 2026-02-13T09:43:22.045 INFO:tasks.workunit.client.0.trial010.stdout:Import successful 2026-02-13T09:43:22.132 INFO:tasks.workunit.client.0.trial010.stdout:reviving divergent 1 2026-02-13T09:43:22.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:579: TEST_divergent_2: echo 'reviving divergent 1' 2026-02-13T09:43:22.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:580: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:22.331 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:22.331 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 4 4 0 0 51688 0 0 11 90 11 active+recovering+degraded 2026-02-13T09:43:20.214474+0000 40'101 46:139 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:43:22.331 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:22.331 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:22.331 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:22.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:581: TEST_divergent_2: activate_osd td/divergent-priors 1 2026-02-13T09:43:22.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:43:22.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:43:22.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:43:22.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:43:22.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:43:22.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:43:22.346 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:43:22.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:43:22.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:43:22.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:43:22.348 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:43:22.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:43:22.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:43:22.349 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:43:22.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:43:22.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:43:22.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:43:22.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:43:22.366 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:22.357+0000 7f20e3dc6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:22.368 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:22.361+0000 7f20e3dc6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:22.369 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:22.361+0000 7f20e3dc6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:22.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:43:22.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:22.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:43:22.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:22.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:22.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:22.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:22.558 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:22.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:22.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:43:22.779 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/1636699692,v1:127.0.0.1:6819/1636699692] [v2:127.0.0.1:6820/1636699692,v1:127.0.0.1:6821/1636699692] exists,up ecf85c02-d562-4877-83ef-3e5a28190370 2026-02-13T09:43:22.780 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:22.780 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:22.780 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:582: TEST_divergent_2: wait_for_osd up 1 2026-02-13T09:43:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:43:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:22.782 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:22.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:22.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:43:22.824 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:22.817+0000 7f20e3dc6a40 -1 Falling back to public interface 2026-02-13T09:43:22.994 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 45 up_thru 45 down_at 28 last_clean_interval [9,26) [v2:127.0.0.1:6818/1636699692,v1:127.0.0.1:6819/1636699692] [v2:127.0.0.1:6820/1636699692,v1:127.0.0.1:6821/1636699692] exists,up ecf85c02-d562-4877-83ef-3e5a28190370 2026-02-13T09:43:22.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:22.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:22.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:22.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:584: TEST_divergent_2: sleep 20 2026-02-13T09:43:23.496 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:23.489+0000 7f20e3dc6a40 -1 osd.1 47 log_to_monitors true 2026-02-13T09:43:42.997 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: get_asok_path osd.1 2026-02-13T09:43:42.997 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:43:42.998 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:43:42.998 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:43:42.999 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:42.999 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:42.999 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:43:42.999 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: CEPH_ARGS= 2026-02-13T09:43:42.999 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:585: TEST_divergent_2: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.1.asok dump_ops_in_flight 2026-02-13T09:43:43.054 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:43:43.054 INFO:tasks.workunit.client.0.trial010.stdout: "ops": [], 2026-02-13T09:43:43.054 INFO:tasks.workunit.client.0.trial010.stdout: "num_ops": 0 2026-02-13T09:43:43.054 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:43:43.059 INFO:tasks.workunit.client.0.trial010.stdout:allowing recovery 2026-02-13T09:43:43.060 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:587: TEST_divergent_2: echo 'allowing recovery' 2026-02-13T09:43:43.060 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:588: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:43.270 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:43.270 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-13T09:43:24.191599+0000 47'102 51:164 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:11:14.748788+0000 0 0 2026-02-13T09:43:43.270 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:43.271 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:43.271 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:43.281 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-13T09:43:43.281 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T09:43:43.355 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:43:43.363 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-13T09:43:43.363 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T09:43:43.446 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:43:43.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:590: TEST_divergent_2: for i in $osds 2026-02-13T09:43:43.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:592: TEST_divergent_2: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T09:43:43.535 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:43:43.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:595: TEST_divergent_2: echo 'reading divergent objects' 2026-02-13T09:43:43.545 INFO:tasks.workunit.client.0.trial010.stdout:reading divergent objects 2026-02-13T09:43:43.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:596: TEST_divergent_2: ceph pg dump pgs 2026-02-13T09:43:43.752 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:43:43.752 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 0 0 0 52200 0 0 12 90 12 active+clean 2026-02-13T09:43:24.191599+0000 47'102 51:164 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:41:42.765766+0000 0'0 2026-02-13T09:41:42.765766+0000 0 0 periodic scrub scheduled @ 2026-02-14T19:11:14.748788+0000 0 0 2026-02-13T09:43:43.752 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:43:43.752 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:43:43.753 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:43:43.761 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: expr 2 + 2 2026-02-13T09:43:43.763 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: seq 1 4 2026-02-13T09:43:43.764 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:43:43.764 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T09:43:43.785 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:43:43.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T09:43:43.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:43:43.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T09:43:43.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:597: TEST_divergent_2: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:43:43.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:599: TEST_divergent_2: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T09:43:43.867 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: seq 1 2 2026-02-13T09:43:43.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:43:43.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-13T09:43:43.888 INFO:tasks.workunit.client.0.trial010.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-13T09:43:43.889 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:601: TEST_divergent_2: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:43:43.889 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:603: TEST_divergent_2: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-13T09:43:43.915 INFO:tasks.workunit.client.0.trial010.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-13T09:43:43.917 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:605: TEST_divergent_2: rm -f td/divergent-priors/existing 2026-02-13T09:43:43.919 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-13T09:43:43.921 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:607: TEST_divergent_2: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:43:43.924 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 26'106 (26'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-13T09:41:58.261281+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:43:43.924 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: keeping 26'106 (26'4) delete 1:70b3bf12:::existing_4:head by client.4549.0:1 2026-02-13T09:41:58.261281+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:43:43.924 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:43:43.924 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 26'4 first_divergent_update: 26'106 last_divergent_update: 26'106 2026-02-13T09:43:43.924 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: more recent entry found: 40'101 (26'4) modify 1:70b3bf12:::existing_4:head by client.4658.0:1 2026-02-13T09:42:43.904505+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 26'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4539.0:1 2026-02-13T09:41:58.254099+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: keeping 26'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4539.0:1 2026-02-13T09:41:58.254099+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 26'101 last_divergent_update: 26'101 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 26'105 (26'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T09:41:58.258528+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: keeping 26'105 (26'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T09:41:58.258528+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 26'3 first_divergent_update: 26'105 last_divergent_update: 26'105 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-13T09:43:43.925 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 26'106 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 26'105 (26'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T09:41:58.258528+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 26'3 <= info.log_tail 26'90 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 26'104 (26'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-13T09:41:58.255370+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: keeping 26'104 (26'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-13T09:41:58.255370+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 26'2 first_divergent_update: 26'104 last_divergent_update: 26'104 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:43:43.926 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 26'106 2026-02-13T09:43:43.927 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 26'104 (26'2) modify 1:97db2a0f:::existing_2:head by client.4543.0:1 2026-02-13T09:41:58.255370+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:43:43.927 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-13T09:43:43.927 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 26'2 <= info.log_tail 26'90 2026-02-13T09:43:43.927 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 26'103 (26'1) modify 1:d858c035:::existing_1:head by client.4542.0:1 2026-02-13T09:41:58.254519+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:43:43.927 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: keeping 26'103 (26'1) modify 1:d858c035:::existing_1:head by client.4542.0:1 2026-02-13T09:41:58.254519+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:43:43.928 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:43:43.928 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 26'1 first_divergent_update: 26'103 last_divergent_update: 26'103 2026-02-13T09:43:43.928 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-13T09:43:43.928 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:43:43.928 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 26'106 2026-02-13T09:43:43.928 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 26'103 (26'1) modify 1:d858c035:::existing_1:head by client.4542.0:1 2026-02-13T09:41:58.254519+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 26'1 <= info.log_tail 26'90 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 26'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4540.0:1 2026-02-13T09:41:58.254159+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 20 _merge_object_divergent_entries: keeping 26'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4540.0:1 2026-02-13T09:41:58.254159+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 26'102 last_divergent_update: 26'102 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-13T09:43:43.929 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:43:20.197+0000 7f08ffaa6640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-13T09:43:43.930 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-13T09:43:43.930 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:609: TEST_divergent_2: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:43:43.930 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: find td/divergent-priors -name '*osd*log' 2026-02-13T09:43:43.931 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:615: TEST_divergent_2: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:43:43.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:620: TEST_divergent_2: echo success 2026-02-13T09:43:43.934 INFO:tasks.workunit.client.0.trial010.stdout:success 2026-02-13T09:43:43.935 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:622: TEST_divergent_2: rm td/divergent-priors/td/divergent-priors/exp.16079.out 2026-02-13T09:43:43.935 INFO:tasks.workunit.client.0.trial010.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16079.out': No such file or directory 2026-02-13T09:43:43.935 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:623: TEST_divergent_2: delete_pool test 2026-02-13T09:43:43.935 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T09:43:43.935 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T09:43:44.193 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' does not exist 2026-02-13T09:43:44.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:624: TEST_divergent_2: kill_daemons td/divergent-priors 2026-02-13T09:43:44.203 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:43:44.203 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:43:44.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:43:44.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:43:44.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:43:49.519 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:43:49.520 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T09:43:49.520 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:43:49.520 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:43:49.520 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:43:49.520 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:43:49.520 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:43:49.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:43:49.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:43:49.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:43:49.527 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:43:49.527 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:43:49.528 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:43:49.529 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:43:49.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:43:49.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:43:49.530 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:43:49.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:43:49.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:43:49.532 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:43:49.532 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:43:49.533 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:43:49.534 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:43:49.534 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:43:49.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:43:49.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.554 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:43:49.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:43:49.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:43:49.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T09:43:49.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:43:49.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:43:49.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:43:49.559 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:43:49.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:43:49.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:43:49.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:43:49.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:43:49.561 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:43:49.562 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:43:49.562 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:43:49.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:43:49.563 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:43:49.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:43:49.565 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:43:49.565 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:43:49.566 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:43:49.566 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.566 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.566 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:43:49.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:43:49.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:43:49.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T09:43:49.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:43:49.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.569 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16079 2026-02-13T09:43:49.571 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:43:49.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T09:43:49.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:43:49.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T09:43:49.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_3 td/divergent-priors 2026-02-13T09:43:49.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:630: TEST_divergent_3: local dir=td/divergent-priors 2026-02-13T09:43:49.572 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: file_with_random_data 2026-02-13T09:43:49.572 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-13T09:43:49.572 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-13T09:43:49.573 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.YUyNCzI43p 2026-02-13T09:43:49.573 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.YUyNCzI43p bs=512 count=1 2026-02-13T09:43:49.574 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:43:49.574 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:43:49.574 INFO:tasks.workunit.client.0.trial010.stderr:512 bytes copied, 0.000229808 s, 2.2 MB/s 2026-02-13T09:43:49.575 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.YUyNCzI43p 2026-02-13T09:43:49.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:632: TEST_divergent_3: local dummyfile=/tmp/tmp.YUyNCzI43p 2026-02-13T09:43:49.575 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: file_with_random_data 1000 2026-02-13T09:43:49.575 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-13T09:43:49.576 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-13T09:43:49.577 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.9n2wfChXp0 2026-02-13T09:43:49.577 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.9n2wfChXp0 bs=1000 count=1 2026-02-13T09:43:49.578 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:43:49.578 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:43:49.578 INFO:tasks.workunit.client.0.trial010.stderr:1000 bytes (1.0 kB) copied, 9.7982e-05 s, 10.2 MB/s 2026-02-13T09:43:49.578 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.9n2wfChXp0 2026-02-13T09:43:49.578 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:634: TEST_divergent_3: local dummyfile2=/tmp/tmp.9n2wfChXp0 2026-02-13T09:43:49.578 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:636: TEST_divergent_3: local num_osds=3 2026-02-13T09:43:49.579 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: expr 3 - 1 2026-02-13T09:43:49.580 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: seq 0 2 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:637: TEST_divergent_3: local 'osds=0 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:638: TEST_divergent_3: run_mon td/divergent-priors a 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T09:43:49.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T09:43:49.613 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:43:49.613 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:43:49.613 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:43:49.614 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:43:49.614 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.614 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.614 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:49.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:43:49.645 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:43:49.646 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:43:49.646 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:43:49.646 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:43:49.646 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:43:49.647 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:43:49.647 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:43:49.647 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:43:49.647 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:43:49.648 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:43:49.648 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.648 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.648 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:43:49.648 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:43:49.648 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get fsid 2026-02-13T09:43:49.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:43:49.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:43:49.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:43:49.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:43:49.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:43:49.704 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:43:49.704 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:43:49.705 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:43:49.705 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:43:49.705 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.705 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.705 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:43:49.705 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:43:49.705 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get mon_host 2026-02-13T09:43:49.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:639: TEST_divergent_3: run_mgr td/divergent-priors x 2026-02-13T09:43:49.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T09:43:49.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:43:49.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:43:49.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:43:49.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T09:43:49.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:43:49.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:43:49.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:43:49.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:43:49.874 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:43:49.874 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.874 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:49.875 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:43:49.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 0 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:43:49.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:49.897 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:43:49.898 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:43:49.899 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:43:49.900 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2bcc8785-bfeb-4753-a151-9e8180ff3494 2026-02-13T09:43:49.900 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 2bcc8785-bfeb-4753-a151-9e8180ff3494' 2026-02-13T09:43:49.900 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 2bcc8785-bfeb-4753-a151-9e8180ff3494 2026-02-13T09:43:49.900 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:43:49.913 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBV8o5paq1UNhAA/kYj7V7ffNBtcY1U8BMYFg== 2026-02-13T09:43:49.913 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBV8o5paq1UNhAA/kYj7V7ffNBtcY1U8BMYFg=="}' 2026-02-13T09:43:49.913 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2bcc8785-bfeb-4753-a151-9e8180ff3494 -i td/divergent-priors/0/new.json 2026-02-13T09:43:50.025 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:50.033 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T09:43:50.035 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBV8o5paq1UNhAA/kYj7V7ffNBtcY1U8BMYFg== --osd-uuid 2bcc8785-bfeb-4753-a151-9e8180ff3494 2026-02-13T09:43:50.054 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.049+0000 7f3cf9db3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:50.055 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.053+0000 7f3cf9db3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:50.056 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.053+0000 7f3cf9db3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:50.056 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.053+0000 7f3cf9db3a40 -1 bdev(0x562a71240c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:43:50.056 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.053+0000 7f3cf9db3a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T09:43:50.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T09:43:50.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:43:50.775 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:43:50.776 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:43:50.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:43:50.901 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:43:50.901 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:43:50.901 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:43:50.902 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:43:50.902 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:43:50.902 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:43:50.932 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.929+0000 7f1930279a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:50.934 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.929+0000 7f1930279a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:50.935 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:50.933+0000 7f1930279a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:51.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:43:51.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:51.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:43:51.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:51.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:51.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:51.014 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:51.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:51.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:51.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:43:51.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:43:51.312 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:51.309+0000 7f1930279a40 -1 Falling back to public interface 2026-02-13T09:43:51.922 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:51.917+0000 7f1930279a40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:43:52.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:43:52.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:52.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:43:52.127 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:43:52.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:52.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:43:52.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:43:53.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:43:53.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:53.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:43:53.252 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:43:53.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:53.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:43:53.465 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/2464907218,v1:127.0.0.1:6801/2464907218] [v2:127.0.0.1:6802/2464907218,v1:127.0.0.1:6803/2464907218] exists,up 2bcc8785-bfeb-4753-a151-9e8180ff3494 2026-02-13T09:43:53.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:53.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:53.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:53.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 1 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:53.466 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:53.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:53.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:43:53.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:43:53.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:43:53.470 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:43:53.470 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=209f01a6-87a6-4e35-bcc3-5d15d67f5e67 2026-02-13T09:43:53.471 INFO:tasks.workunit.client.0.trial010.stdout:add osd1 209f01a6-87a6-4e35-bcc3-5d15d67f5e67 2026-02-13T09:43:53.471 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 209f01a6-87a6-4e35-bcc3-5d15d67f5e67' 2026-02-13T09:43:53.471 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:43:53.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBZ8o5pPxu9HBAAed+IdiADHdto0mtZrv3Lbw== 2026-02-13T09:43:53.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBZ8o5pPxu9HBAAed+IdiADHdto0mtZrv3Lbw=="}' 2026-02-13T09:43:53.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 209f01a6-87a6-4e35-bcc3-5d15d67f5e67 -i td/divergent-priors/1/new.json 2026-02-13T09:43:53.710 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:43:53.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T09:43:53.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBZ8o5pPxu9HBAAed+IdiADHdto0mtZrv3Lbw== --osd-uuid 209f01a6-87a6-4e35-bcc3-5d15d67f5e67 2026-02-13T09:43:53.739 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:53.737+0000 7f60bb5a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:53.741 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:53.737+0000 7f60bb5a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:53.742 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:53.737+0000 7f60bb5a5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:53.742 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:53.741+0000 7f60bb5a5a40 -1 bdev(0x5608f2a78c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T09:43:53.742 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:53.741+0000 7f60bb5a5a40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T09:43:54.355 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T09:43:54.355 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:43:54.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T09:43:54.357 INFO:tasks.workunit.client.0.trial010.stdout:adding osd1 key to auth repository 2026-02-13T09:43:54.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:43:54.660 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:43:54.661 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T09:43:54.661 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:43:54.661 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:43:54.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:43:54.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:43:54.689 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:54.685+0000 7f9e6602aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:54.691 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:54.689+0000 7f9e6602aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:54.692 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:54.689+0000 7f9e6602aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:54.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T09:43:54.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:54.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:43:54.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:54.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:54.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:54.879 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:54.879 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:54.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:54.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:43:55.084 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:55.081+0000 7f9e6602aa40 -1 Falling back to public interface 2026-02-13T09:43:55.089 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:43:55.696 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:55.693+0000 7f9e6602aa40 -1 osd.1 0 log_to_monitors true 2026-02-13T09:43:56.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:43:56.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:56.091 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:43:56.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:43:56.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:56.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:43:56.307 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1066265139,v1:127.0.0.1:6811/1066265139] [v2:127.0.0.1:6812/1066265139,v1:127.0.0.1:6813/1066265139] exists,up 209f01a6-87a6-4e35-bcc3-5d15d67f5e67 2026-02-13T09:43:56.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:56.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:56.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:56.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:640: TEST_divergent_3: for i in $osds 2026-02-13T09:43:56.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:642: TEST_divergent_3: run_osd td/divergent-priors 2 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:43:56.309 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:43:56.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:43:56.311 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:43:56.312 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=25739b1b-5ac0-4c55-a098-a8ff66bc52a1 2026-02-13T09:43:56.312 INFO:tasks.workunit.client.0.trial010.stdout:add osd2 25739b1b-5ac0-4c55-a098-a8ff66bc52a1 2026-02-13T09:43:56.312 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 25739b1b-5ac0-4c55-a098-a8ff66bc52a1' 2026-02-13T09:43:56.313 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:43:56.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBc8o5pPaVfExAALTQhqN9hej1rCtuayud6cQ== 2026-02-13T09:43:56.327 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBc8o5pPaVfExAALTQhqN9hej1rCtuayud6cQ=="}' 2026-02-13T09:43:56.327 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 25739b1b-5ac0-4c55-a098-a8ff66bc52a1 -i td/divergent-priors/2/new.json 2026-02-13T09:43:56.550 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:43:56.560 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T09:43:56.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBc8o5pPaVfExAALTQhqN9hej1rCtuayud6cQ== --osd-uuid 25739b1b-5ac0-4c55-a098-a8ff66bc52a1 2026-02-13T09:43:56.580 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:56.577+0000 7f2f8ca5ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:56.582 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:56.577+0000 7f2f8ca5ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:56.583 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:56.581+0000 7f2f8ca5ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:56.583 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:56.581+0000 7f2f8ca5ea40 -1 bdev(0x55fa5f9e6c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T09:43:56.584 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:56.581+0000 7f2f8ca5ea40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T09:43:57.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T09:43:57.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:43:57.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T09:43:57.206 INFO:tasks.workunit.client.0.trial010.stdout:adding osd2 key to auth repository 2026-02-13T09:43:57.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:43:57.508 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T09:43:57.508 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:43:57.508 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:43:57.508 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:43:57.508 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:43:57.508 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:43:57.536 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:57.533+0000 7f2913759a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:57.538 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:57.537+0000 7f2913759a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:57.539 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:57.537+0000 7f2913759a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:43:57.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T09:43:57.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:43:57.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:43:57.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:43:57.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:43:57.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:57.720 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:43:57.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:43:57.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:57.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:43:57.852 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:57.849+0000 7f2913759a40 -1 Falling back to public interface 2026-02-13T09:43:57.940 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:43:58.546 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:43:58.541+0000 7f2913759a40 -1 osd.2 0 log_to_monitors true 2026-02-13T09:43:58.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:43:58.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:43:58.942 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:43:58.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:43:58.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:43:58.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:43:59.169 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3196838609,v1:127.0.0.1:6819/3196838609] [v2:127.0.0.1:6820/3196838609,v1:127.0.0.1:6821/3196838609] exists,up 25739b1b-5ac0-4c55-a098-a8ff66bc52a1 2026-02-13T09:43:59.170 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:43:59.170 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:43:59.170 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:43:59.170 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:645: TEST_divergent_3: ceph osd set noout 2026-02-13T09:43:59.458 INFO:tasks.workunit.client.0.trial010.stderr:noout is set 2026-02-13T09:43:59.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:646: TEST_divergent_3: ceph osd set noin 2026-02-13T09:43:59.761 INFO:tasks.workunit.client.0.trial010.stderr:noin is set 2026-02-13T09:43:59.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:647: TEST_divergent_3: ceph osd set nodown 2026-02-13T09:44:00.065 INFO:tasks.workunit.client.0.trial010.stderr:nodown is set 2026-02-13T09:44:00.076 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:648: TEST_divergent_3: create_pool test 1 1 2026-02-13T09:44:00.076 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 2026-02-13T09:44:00.324 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' already exists 2026-02-13T09:44:00.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:44:01.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:649: TEST_divergent_3: ceph osd pool set test size 3 2026-02-13T09:44:01.650 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 size to 3 2026-02-13T09:44:01.660 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:650: TEST_divergent_3: ceph osd pool set test min_size 2 2026-02-13T09:44:01.955 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 min_size to 2 2026-02-13T09:44:01.965 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:653: TEST_divergent_3: ceph osd pool set test pg_autoscale_mode on 2026-02-13T09:44:02.260 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 pg_autoscale_mode to on 2026-02-13T09:44:02.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:655: TEST_divergent_3: divergent=-1 2026-02-13T09:44:02.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: date +%s 2026-02-13T09:44:02.273 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:656: TEST_divergent_3: start_time=1770975842 2026-02-13T09:44:02.273 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:657: TEST_divergent_3: max_duration=300 2026-02-13T09:44:02.273 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' -1 -le -1 ']' 2026-02-13T09:44:02.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:661: TEST_divergent_3: flush_pg_stats 2026-02-13T09:44:02.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:44:02.274 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:44:02.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:44:02.492 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:44:02.492 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:44:02.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:44:02.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:02.492 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:44:02.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836484 2026-02-13T09:44:02.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836484 2026-02-13T09:44:02.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484' 2026-02-13T09:44:02.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:02.576 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:44:02.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-13T09:44:02.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-13T09:44:02.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668' 2026-02-13T09:44:02.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:02.654 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:44:02.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-13T09:44:02.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-13T09:44:02.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836484 1-38654705668 2-55834574851' 2026-02-13T09:44:02.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:02.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836484 2026-02-13T09:44:02.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:02.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:44:02.734 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836484 2026-02-13T09:44:02.734 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:02.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836484 2026-02-13T09:44:02.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836484' 2026-02-13T09:44:02.736 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836484 2026-02-13T09:44:02.736 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:02.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836482 -lt 21474836484 2026-02-13T09:44:02.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:44:03.952 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:44:03.953 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:04.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836484 2026-02-13T09:44:04.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:04.174 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-13T09:44:04.174 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:04.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:44:04.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-13T09:44:04.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:04.177 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-13T09:44:04.177 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-13T09:44:04.178 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705668 2026-02-13T09:44:04.178 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:44:04.400 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-13T09:44:04.400 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:04.401 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-13T09:44:04.401 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:04.402 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:44:04.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-13T09:44:04.403 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:04.404 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-13T09:44:04.404 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574851 2026-02-13T09:44:04.404 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-13T09:44:04.405 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:44:04.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-13T09:44:04.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:662: TEST_divergent_3: wait_for_clean 2026-02-13T09:44:04.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:44:04.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:44:04.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:44:04.619 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:44:04.620 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:44:04.620 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:44:04.620 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:44:04.620 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:44:04.621 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:44:04.728 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:44:04.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:44:04.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:44:04.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:44:04.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:44:04.729 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:44:04.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:44:04.951 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:44:04.952 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:44:04.952 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:44:04.952 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:04.952 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:44:05.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-13T09:44:05.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-13T09:44:05.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-13T09:44:05.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:05.032 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:44:05.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-13T09:44:05.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-13T09:44:05.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-13T09:44:05.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:05.117 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:44:05.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574854 2026-02-13T09:44:05.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574854 2026-02-13T09:44:05.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574854' 2026-02-13T09:44:05.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:05.193 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-13T09:44:05.194 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:05.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:44:05.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-13T09:44:05.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:05.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-13T09:44:05.197 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836487 2026-02-13T09:44:05.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-13T09:44:05.197 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:05.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836487 2026-02-13T09:44:05.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:44:06.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:44:06.429 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:06.641 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-13T09:44:06.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:06.642 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-13T09:44:06.642 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:06.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:44:06.644 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705670 2026-02-13T09:44:06.644 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:06.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705670 2026-02-13T09:44:06.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-13T09:44:06.646 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705670 2026-02-13T09:44:06.646 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:44:06.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-13T09:44:06.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:06.878 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574854 2026-02-13T09:44:06.878 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:06.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:44:06.880 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574854 2026-02-13T09:44:06.880 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:06.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574854 2026-02-13T09:44:06.882 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574854 2026-02-13T09:44:06.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574854' 2026-02-13T09:44:06.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:44:07.113 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574854 2026-02-13T09:44:07.113 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:44:07.114 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:07.114 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:07.405 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:44:07.406 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:07.406 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:07.407 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:07.407 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:07.407 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:07.407 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:07.407 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:07.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:44:07.621 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:07.621 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:07.621 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:07.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:44:07.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:44:07.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:44:07.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: ceph pg dump pgs --format=json 2026-02-13T09:44:07.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: jq '.pg_stats[0].up_primary' 2026-02-13T09:44:08.109 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:44:08.119 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:665: TEST_divergent_3: divergent=1 2026-02-13T09:44:08.119 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:666: TEST_divergent_3: echo 'primary and soon to be divergent is 1' 2026-02-13T09:44:08.119 INFO:tasks.workunit.client.0.trial010.stdout:primary and soon to be divergent is 1 2026-02-13T09:44:08.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:667: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:44:08.319 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:44:08.320 INFO:tasks.workunit.client.0.trial010.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T09:44:00.550440+0000 0'0 28:24 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:26:09.809614+0000 0 0 2026-02-13T09:44:08.320 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:44:08.320 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:44:08.320 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:44:08.328 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: date +%s 2026-02-13T09:44:08.329 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:669: TEST_divergent_3: current_time=1770975848 2026-02-13T09:44:08.330 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: expr 1770975848 - 1770975842 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:670: TEST_divergent_3: elapsed_time=6 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:671: TEST_divergent_3: '[' 6 -gt 300 ']' 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:659: TEST_divergent_3: '[' 1 -le -1 ']' 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:677: TEST_divergent_3: local non_divergent= 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 0 = 1 ']' 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0' 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-13T09:44:08.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 1 = 1 ']' 2026-02-13T09:44:08.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:681: TEST_divergent_3: continue 2026-02-13T09:44:08.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:678: TEST_divergent_3: for i in $osds 2026-02-13T09:44:08.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:680: TEST_divergent_3: '[' 2 = 1 ']' 2026-02-13T09:44:08.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:683: TEST_divergent_3: non_divergent=' 0 2' 2026-02-13T09:44:08.333 INFO:tasks.workunit.client.0.trial010.stdout:writing initial objects 2026-02-13T09:44:08.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:686: TEST_divergent_3: echo 'writing initial objects' 2026-02-13T09:44:08.334 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: seq 1 100 2026-02-13T09:44:08.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.355 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.355 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_3 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.410 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.410 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.436 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.436 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_5 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_6 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_7 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_8 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_9 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_10 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.605 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.605 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_11 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_12 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.660 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.660 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_13 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_14 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.716 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.717 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_15 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.745 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.745 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_16 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_17 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.800 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.800 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_18 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_19 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.856 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.856 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_20 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_21 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_22 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_23 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.960 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.960 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_24 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:08.987 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:08.987 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_25 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_26 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.043 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.043 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_27 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_28 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_29 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_30 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_31 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.181 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.181 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_32 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.209 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.209 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_33 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.237 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_34 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_35 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.292 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.292 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_36 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.320 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.321 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_37 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_38 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_39 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_40 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_41 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_42 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.479 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.479 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_43 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_44 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.535 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.535 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_45 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_46 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.591 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.591 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_47 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_48 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_49 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_50 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_51 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.728 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.728 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_52 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.756 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.756 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_53 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.777 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.777 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_54 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_55 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_56 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_57 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.887 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.887 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_58 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_59 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.935 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_60 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.963 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.963 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_61 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:09.989 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:09.989 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_62 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_63 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.044 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.044 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_64 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.072 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.072 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_65 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.100 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.100 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_66 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_67 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_68 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.182 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.183 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_69 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.211 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.211 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_70 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_71 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_72 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.296 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.296 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_73 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.324 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.324 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_74 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.352 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.352 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_75 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_76 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.408 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_77 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_78 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_79 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.491 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.491 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_80 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.519 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.519 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_81 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_82 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_83 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.602 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.603 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_84 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_85 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.659 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.659 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_86 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.680 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.680 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_87 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_88 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_89 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_90 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.789 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_91 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.816 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.816 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_92 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_93 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.871 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.871 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_94 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.892 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_95 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_96 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_97 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:10.974 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:10.974 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_98 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:11.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:11.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_99 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:11.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:688: TEST_divergent_3: for i in $(seq 1 $testobjects) 2026-02-13T09:44:11.030 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:690: TEST_divergent_3: rados -p test put existing_100 /tmp/tmp.YUyNCzI43p 2026-02-13T09:44:11.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:44:11.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:693: TEST_divergent_3: wait_for_clean 2026-02-13T09:44:11.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:44:11.059 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:44:11.060 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:44:11.060 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:44:11.060 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:44:11.060 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:44:11.061 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:44:11.061 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:44:11.061 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:44:11.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:44:11.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:44:11.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:44:11.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:44:11.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:44:11.132 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:44:11.344 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:44:11.345 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:44:11.345 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:44:11.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:44:11.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:11.345 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:44:11.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836490 2026-02-13T09:44:11.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836490 2026-02-13T09:44:11.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490' 2026-02-13T09:44:11.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:11.428 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:44:11.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-13T09:44:11.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-13T09:44:11.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705673' 2026-02-13T09:44:11.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:11.513 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:44:11.590 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574857 2026-02-13T09:44:11.590 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574857 2026-02-13T09:44:11.590 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836490 1-38654705673 2-55834574857' 2026-02-13T09:44:11.590 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:11.591 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836490 2026-02-13T09:44:11.591 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:11.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:44:11.593 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836490 2026-02-13T09:44:11.593 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:11.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836490 2026-02-13T09:44:11.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836490' 2026-02-13T09:44:11.595 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836490 2026-02-13T09:44:11.595 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:11.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836488 -lt 21474836490 2026-02-13T09:44:11.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:44:12.818 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:44:12.819 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:13.036 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836490 -lt 21474836490 2026-02-13T09:44:13.036 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:13.036 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-13T09:44:13.036 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:13.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:44:13.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705673 2026-02-13T09:44:13.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:13.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705673 2026-02-13T09:44:13.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-13T09:44:13.040 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705673 2026-02-13T09:44:13.040 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:44:13.256 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705674 -lt 38654705673 2026-02-13T09:44:13.256 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:13.257 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574857 2026-02-13T09:44:13.257 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:13.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:44:13.259 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574857 2026-02-13T09:44:13.259 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:13.260 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574857 2026-02-13T09:44:13.261 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574857 2026-02-13T09:44:13.261 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574857' 2026-02-13T09:44:13.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:44:13.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574857 -lt 55834574857 2026-02-13T09:44:13.484 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:44:13.484 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:13.484 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:13.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:44:13.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:13.762 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:13.762 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:13.762 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:13.762 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:13.762 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:13.762 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:13.970 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:44:13.970 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:13.971 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:13.971 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:14.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:44:14.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:44:14.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:44:14.249 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: get_pg test existing_1 2026-02-13T09:44:14.249 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T09:44:14.250 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T09:44:14.250 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T09:44:14.250 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T09:44:14.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:695: TEST_divergent_3: local pgid=1.0 2026-02-13T09:44:14.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:698: TEST_divergent_3: echo 'blackholing osds 0 2' 2026-02-13T09:44:14.461 INFO:tasks.workunit.client.0.trial010.stdout:blackholing osds 0 2 2026-02-13T09:44:14.461 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:699: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:44:14.667 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:44:14.667 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T09:44:00.550440+0000 28'100 28:124 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:26:09.809614+0000 0 0 2026-02-13T09:44:14.668 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:44:14.668 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:44:14.668 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:44:14.677 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:14.677 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.0 2026-02-13T09:44:14.677 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:44:14.677 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:44:14.678 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:44:14.678 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:44:14.678 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:44:14.678 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:44:14.679 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-13T09:44:14.679 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T09:44:14.733 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:44:14.733 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:44:14.733 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:44:14.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:700: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:14.739 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: get_asok_path osd.2 2026-02-13T09:44:14.739 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:44:14.739 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:44:14.739 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:44:14.740 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:44:14.740 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:44:14.740 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:44:14.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: CEPH_ARGS= 2026-02-13T09:44:14.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:702: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T09:44:14.792 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:44:14.792 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:44:14.792 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:44:14.797 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:706: TEST_divergent_3: echo 'create new divergent objects' 2026-02-13T09:44:14.797 INFO:tasks.workunit.client.0.trial010.stdout:create new divergent objects 2026-02-13T09:44:14.798 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: seq 1 2 2026-02-13T09:44:14.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:44:14.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:707: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:44:14.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_1 2026-02-13T09:44:14.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:712: TEST_divergent_3: echo 'writing divergent objects' 2026-02-13T09:44:14.799 INFO:tasks.workunit.client.0.trial010.stdout:writing divergent objects 2026-02-13T09:44:14.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:709: TEST_divergent_3: rados -p test create newobject_2 2026-02-13T09:44:14.799 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: seq 1 2 2026-02-13T09:44:14.800 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T09:44:14.801 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:713: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_WRITE) 2026-02-13T09:44:14.801 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_1 /tmp/tmp.9n2wfChXp0 2026-02-13T09:44:14.801 INFO:tasks.workunit.client.0.trial010.stdout:remove divergent objects 2026-02-13T09:44:14.801 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:718: TEST_divergent_3: echo 'remove divergent objects' 2026-02-13T09:44:14.801 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:715: TEST_divergent_3: rados -p test put existing_2 /tmp/tmp.9n2wfChXp0 2026-02-13T09:44:14.801 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: seq 1 2 2026-02-13T09:44:14.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T09:44:14.803 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 1 + 2 2026-02-13T09:44:14.804 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=3 2026-02-13T09:44:14.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:719: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_REMOVE) 2026-02-13T09:44:14.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_3 2026-02-13T09:44:14.805 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: expr 2 + 2 2026-02-13T09:44:14.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:721: TEST_divergent_3: rmi=4 2026-02-13T09:44:14.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:724: TEST_divergent_3: sleep 10 2026-02-13T09:44:14.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:722: TEST_divergent_3: rados -p test rm existing_4 2026-02-13T09:44:24.808 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:725: TEST_divergent_3: killall -9 rados 2026-02-13T09:44:24.860 INFO:tasks.workunit.client.0.trial010.stderr:rados: no process found 2026-02-13T09:44:24.860 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:728: TEST_divergent_3: echo 'killing all the osds' 2026-02-13T09:44:24.860 INFO:tasks.workunit.client.0.trial010.stdout:killing all the osds 2026-02-13T09:44:24.861 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:729: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:44:25.075 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:44:25.075 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 active+clean 2026-02-13T09:44:00.550440+0000 28'106 28:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:26:09.809614+0000 0 0 2026-02-13T09:44:25.075 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:44:25.075 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:44:25.076 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:44:25.084 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:730: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd 2026-02-13T09:44:25.085 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:44:25.085 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:44:25.085 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:44:25.085 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:44:25.085 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:44:25.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:44:25.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-13T09:44:25.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.0 2026-02-13T09:44:25.455 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:44:25.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-13T09:44:25.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.1 2026-02-13T09:44:25.741 INFO:tasks.workunit.client.0.trial010.stderr:osd.1 is already down. 2026-02-13T09:44:25.753 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:731: TEST_divergent_3: for i in $osds 2026-02-13T09:44:25.754 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:733: TEST_divergent_3: ceph osd down osd.2 2026-02-13T09:44:26.019 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already down. 2026-02-13T09:44:26.031 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:26.031 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.0 2026-02-13T09:44:26.311 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already out. 2026-02-13T09:44:26.320 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:735: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:26.320 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:737: TEST_divergent_3: ceph osd out osd.2 2026-02-13T09:44:26.599 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already out. 2026-02-13T09:44:26.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:741: TEST_divergent_3: echo 'bringing up non_divergent 0 2' 2026-02-13T09:44:26.611 INFO:tasks.workunit.client.0.trial010.stdout:bringing up non_divergent 0 2 2026-02-13T09:44:26.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:742: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:44:26.809 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:44:26.809 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51152 0 0 16 90 16 stale+active+clean 2026-02-13T09:44:00.550440+0000 28'106 28:130 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:26:09.809614+0000 0 0 2026-02-13T09:44:26.809 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:44:26.809 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:44:26.809 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 0 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:44:26.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:44:26.822 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:44:26.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:44:26.824 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:44:26.824 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:44:26.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:44:26.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:44:26.825 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T09:44:26.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:44:26.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:44:26.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:44:26.826 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:44:26.844 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:26.841+0000 7f8eae201a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:44:26.845 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:26.841+0000 7f8eae201a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:44:26.846 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:26.845+0000 7f8eae201a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:44:27.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:44:27.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:44:27.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:44:27.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:44:27.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:44:27.046 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:44:27.047 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:44:27.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:44:27.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:44:27.047 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:44:27.203 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:27.201+0000 7f8eae201a40 -1 Falling back to public interface 2026-02-13T09:44:27.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:44:27.864 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:27.861+0000 7f8eae201a40 -1 osd.0 28 log_to_monitors true 2026-02-13T09:44:28.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:44:28.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:44:28.267 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:44:28.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:44:28.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:44:28.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:44:28.479 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up out weight 0 up_from 35 up_thru 0 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/2558892804,v1:127.0.0.1:6801/2558892804] [v2:127.0.0.1:6802/2558892804,v1:127.0.0.1:6803/2558892804] exists,up 2bcc8785-bfeb-4753-a151-9e8180ff3494 2026-02-13T09:44:28.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:44:28.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:743: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:745: TEST_divergent_3: activate_osd td/divergent-priors 2 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:44:28.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:44:28.484 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:44:28.485 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:44:28.486 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:44:28.486 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:44:28.486 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:44:28.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:44:28.487 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T09:44:28.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:44:28.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:44:28.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:44:28.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:44:28.501 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:28.497+0000 7fec77a78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:44:28.502 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:28.501+0000 7fec77a78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:44:28.503 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:28.501+0000 7fec77a78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:44:28.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:44:28.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:44:28.704 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:44:28.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:44:28.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:44:28.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:44:28.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:44:28.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:44:28.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:44:28.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:44:28.896 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:28.893+0000 7fec77a78a40 -1 Falling back to public interface 2026-02-13T09:44:28.917 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:44:29.569 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:44:29.565+0000 7fec77a78a40 -1 osd.2 28 log_to_monitors true 2026-02-13T09:44:29.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:44:29.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:44:29.919 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:44:29.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:44:29.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:44:29.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:44:30.132 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up out weight 0 up_from 38 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/1124534624,v1:127.0.0.1:6811/1124534624] [v2:127.0.0.1:6812/1124534624,v1:127.0.0.1:6813/1124534624] exists,up 25739b1b-5ac0-4c55-a098-a8ff66bc52a1 2026-02-13T09:44:30.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:44:30.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:44:30.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:44:30.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:30.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.0 2026-02-13T09:44:30.378 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already in. 2026-02-13T09:44:30.387 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:747: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:44:30.387 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:749: TEST_divergent_3: ceph osd in osd.2 2026-02-13T09:44:30.663 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already in. 2026-02-13T09:44:30.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:44:30.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:752: TEST_divergent_3: wait_for_clean 2026-02-13T09:44:30.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:44:30.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:44:30.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:44:30.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:44:30.674 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:44:30.674 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:44:30.674 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:44:30.674 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:44:30.674 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:44:30.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:44:30.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:44:30.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:44:30.742 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:44:30.743 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:44:30.743 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:44:30.959 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:44:30.959 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:44:30.959 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:44:30.959 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:44:30.959 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:30.960 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:44:31.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855363 2026-02-13T09:44:31.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855363 2026-02-13T09:44:31.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855363' 2026-02-13T09:44:31.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:31.042 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:44:31.100 INFO:tasks.workunit.client.0.trial010.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-13T09:44:31.103 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T09:44:31.103 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T09:44:31.103 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T09:44:31.103 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:44:31.104 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:44:31.182 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-13T09:44:31.183 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-13T09:44:31.183 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855363 2-163208757251' 2026-02-13T09:44:31.183 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:31.183 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855363 2026-02-13T09:44:31.183 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:31.184 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:44:31.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-150323855363 2026-02-13T09:44:31.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:31.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855363 2026-02-13T09:44:31.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 150323855363' 2026-02-13T09:44:31.187 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 150323855363 2026-02-13T09:44:31.187 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:31.403 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 150323855363 2026-02-13T09:44:31.403 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:44:32.404 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:44:32.405 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:44:32.626 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855363 -lt 150323855363 2026-02-13T09:44:32.626 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:44:32.626 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-13T09:44:32.627 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:44:32.628 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:44:32.629 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757251 2026-02-13T09:44:32.629 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:44:32.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-13T09:44:32.630 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 163208757251 2026-02-13T09:44:32.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-13T09:44:32.631 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:44:32.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757251 -lt 163208757251 2026-02-13T09:44:32.859 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:44:32.860 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:32.860 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:33.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:44:33.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:33.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:33.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:33.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:33.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:33.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:33.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:33.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:33.367 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:33.367 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:33.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:33.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:33.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T09:44:33.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T09:44:33.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T09:44:33.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:33.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T09:44:33.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:33.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:33.770 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:33.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:33.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:33.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:33.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:33.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:33.988 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:33.988 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:33.989 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:33.989 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:34.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:34.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:34.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:34.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:34.286 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:34.286 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:34.286 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:34.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:34.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:34.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:34.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:34.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T09:44:34.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:34.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T09:44:34.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:34.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:34.777 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:34.777 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:34.777 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:34.777 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:34.777 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:34.777 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:34.989 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:34.990 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:34.990 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:34.990 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:35.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:35.273 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:35.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:35.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:35.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T09:44:35.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:35.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T09:44:35.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:35.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:35.950 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:35.950 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:35.950 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:35.951 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:35.951 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:35.951 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:36.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:36.164 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:36.165 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:36.165 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:36.451 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:36.745 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:36.745 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:36.745 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T09:44:36.745 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:36.745 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T09:44:37.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:37.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:37.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:37.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:37.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:37.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:37.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:37.548 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:37.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:37.767 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:37.767 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:37.767 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:38.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:38.056 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:38.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:38.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:38.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T09:44:38.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:38.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T09:44:39.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:39.942 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:39.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:39.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:39.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:39.943 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:39.944 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:39.944 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:40.160 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:40.160 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:40.161 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:40.161 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:40.452 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:40.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:40.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:40.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:40.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:40.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:40.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:40.454 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:40.454 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:40.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:40.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:40.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T09:44:40.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:40.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T09:44:43.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:43.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:43.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:43.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:43.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:43.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:43.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:43.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:44.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:44.149 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:44.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:44.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:44.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:44.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:44.430 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:44.430 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:44.430 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:44.430 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:44.430 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:44.430 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:44.431 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:44.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:44.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:44.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T09:44:44.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:44.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T09:44:51.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:51.108 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:51.108 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:51.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:51.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:51.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:51.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:51.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:51.319 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:51.319 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:51.320 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:51.320 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:51.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:44:51.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:51.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:51.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:51.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:51.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:51.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:51.599 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:51.599 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:51.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:51.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:51.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T09:44:51.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:44:51.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T09:44:59.183 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:44:59.184 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:44:59.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:44:59.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:44:59.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:44:59.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:44:59.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:44:59.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:44:59.392 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:44:59.392 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:44:59.393 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:44:59.393 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:44:59.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:44:59.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:44:59.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:44:59.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:44:59.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:44:59.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:44:59.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:44:59.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:44:59.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:44:59.947 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:44:59.947 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:44:59.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T09:44:59.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T09:45:00.233 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:45:00.233 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_fingerprint": "f8a62dcf-3e9f-4c5b-a322-5f105d56e1db", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "version": "20.2.0-636-g3b40640f", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "commit": "3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "timestamp": "2026-02-13T09:45:00.231775+0000", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "tag": "", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "health": { 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "status": "HEALTH_WARN", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "checks": { 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "OSDMAP_FLAGS": { 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T09:45:00.234 INFO:tasks.workunit.client.0.trial010.stdout: "count": 17 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [], 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "OSD_DOWN": { 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "message": "1 osds down", 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:45:00.235 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "message": "osd.1 (root=default,host=trial010) is down" 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "PG_DEGRADED": { 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "count": 32 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.236 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.0 is active+undersized+degraded+wait, acting [0,2]" 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.237 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.238 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.239 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.240 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.241 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.242 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.243 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: "mutes": [] 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_first_committed": 1, 2026-02-13T09:45:00.244 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_last_committed": 1, 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "monmap": { 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:43:49.603644Z", 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:43:49.603644Z", 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release": 20, 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release_name": "tentacle", 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "election_strategy": 1, 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "disallowed_leaders": "", 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": false, 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "tiebreaker_mon": "", 2026-02-13T09:45:00.245 INFO:tasks.workunit.client.0.trial010.stdout: "removed_ranks": "", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "features": { 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "persistent": [ 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "kraken", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "luminous", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "mimic", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap-prune", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "nautilus", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "octopus", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "pacific", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "elector-pinging", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "quincy", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "reef", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "squid", 2026-02-13T09:45:00.246 INFO:tasks.workunit.client.0.trial010.stdout: "tentacle", 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "nvmeof_beacon_diff" 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "optional": [] 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "mons": [ 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "rank": 0, 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "name": "a", 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.247 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115", 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 0 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: "priority": 0, 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 0, 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: "crush_location": "{}" 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.248 INFO:tasks.workunit.client.0.trial010.stdout: "quorum": [ 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: 0 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap": { 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 44, 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:43:49.690915+0000", 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:44:54.241862+0000", 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "last_up_change": "2026-02-13T09:44:29.723673+0000", 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "last_in_change": "2026-02-13T09:44:30.606397+0000", 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "flags_num": 5800384, 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "flags_set": [ 2026-02-13T09:45:00.249 INFO:tasks.workunit.client.0.trial010.stdout: "nodown", 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "noin", 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "noout", 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "pglog_hardlimit", 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snapdirs", 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "recovery_deletes", 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "sortbitwise" 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "crush_version": 9, 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_snapshot": "", 2026-02-13T09:45:00.250 INFO:tasks.workunit.client.0.trial010.stdout: "pool_max": 1, 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "max_osd": 3, 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "require_min_compat_client": "luminous", 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "min_compat_client": "jewel", 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "require_osd_release": "tentacle", 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "allow_crimson": false, 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "pools": [ 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "pool_name": "test", 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "create_time": "2026-02-13T09:44:00.241411+0000", 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "flags": 1, 2026-02-13T09:45:00.251 INFO:tasks.workunit.client.0.trial010.stdout: "flags_names": "hashpspool", 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "size": 3, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "min_size": 2, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "crush_rule": 0, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_count": 0, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_target": 0, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "is_stretch_pool": false, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "object_hash": 2, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "pg_autoscale_mode": "on", 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num": 32, 2026-02-13T09:45:00.252 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num": 1, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num_target": 32, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_target": 32, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_pending": 32, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "last_pg_merge_meta": { 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "source_pgid": "0.0", 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "ready_epoch": 0, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_started": 0, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": 0, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "source_version": "0'0", 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "target_version": "0'0" 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "last_change": "43", 2026-02-13T09:45:00.253 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend": "0", 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_preluminous": "43", 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "auid": 0, 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "snap_mode": "selfmanaged", 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "snap_seq": 0, 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "snap_epoch": 0, 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "pool_snaps": [], 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps": "[]", 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_bytes": 0, 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_objects": 0, 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "tiers": [], 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "tier_of": -1, 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "read_tier": -1, 2026-02-13T09:45:00.254 INFO:tasks.workunit.client.0.trial010.stdout: "write_tier": -1, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "cache_mode": "none", 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_bytes": 0, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_objects": 0, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_flush_age": 0, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_evict_age": 0, 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profile": "", 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_params": { 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: "type": "none" 2026-02-13T09:45:00.255 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_period": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_count": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "use_gmt_hitset": true, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "min_read_recency_for_promote": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "min_write_recency_for_promote": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_search_last_n": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "grade_table": [], 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "stripe_width": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "expected_num_objects": 0, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "fast_read": false, 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "nonprimary_shards": "{}", 2026-02-13T09:45:00.256 INFO:tasks.workunit.client.0.trial010.stdout: "options": {}, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "application_metadata": {}, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "read_balance": { 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "score_type": "Fair distribution", 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "score_acting": 2.9900000095367432, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "score_stable": 2.9900000095367432, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_acting": 2, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_stable": 2, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity_weighted": 1, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity": 1, 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity_weighted": 1 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.257 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "osds": [ 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "2bcc8785-bfeb-4753-a151-9e8180ff3494", 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 5, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 28, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 35, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 43, 2026-02-13T09:45:00.258 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 29, 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6800", 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6801", 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.259 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6802", 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6803", 2026-02-13T09:45:00.260 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6806", 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.261 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6807", 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6804", 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.262 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6805", 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6801/2558892804", 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6803/2558892804", 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2558892804", 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2558892804", 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.263 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "209f01a6-87a6-4e35-bcc3-5d15d67f5e67", 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "up": 0, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 0, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 0, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 9, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 20, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 30, 2026-02-13T09:45:00.264 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.265 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.266 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.267 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:45:00.268 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/1066265139", 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/1066265139", 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1066265139", 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1066265139", 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: "exists" 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.269 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "25739b1b-5ac0-4c55-a098-a8ff66bc52a1", 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 13, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 28, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 38, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 0, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 31, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.270 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.271 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.272 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:45:00.273 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/1124534624", 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/1124534624", 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1124534624", 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1124534624", 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:45:00.274 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "osd_xinfo": [ 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:44:25.398563+0000", 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:43:52.950371+0000", 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:00.275 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:44:25.683353+0000", 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:44:25.963411+0000", 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:43:59.591972+0000", 2026-02-13T09:45:00.276 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap": [], 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_items": [], 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_primaries": [], 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "pg_temp": [], 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "primary_temp": [], 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "blocklist": {}, 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "range_blocklist": {}, 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profiles": { 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "default": { 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "m": "2", 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.277 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps_queue": [], 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "new_removed_snaps": [], 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "new_purged_snaps": [], 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "crush_node_flags": {}, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "device_class_flags": {}, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": { 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_enabled": false, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_bucket_count": 0, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "degraded_stretch_mode": 0, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "recovering_stretch_mode": 0, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_bucket": 0 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "osd_metadata": [ 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:00.278 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6802/2558892804,v1:127.0.0.1:6803/2558892804]", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:45:00.279 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:43:50.662176Z", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6800/2558892804,v1:127.0.0.1:6801/2558892804]", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2558892804,v1:127.0.0.1:6807/2558892804]", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2558892804,v1:127.0.0.1:6805/2558892804]", 2026-02-13T09:45:00.280 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.281 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/1066265139,v1:127.0.0.1:6813/1066265139]", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:45:00.282 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:43:54.256618Z", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/1066265139,v1:127.0.0.1:6811/1066265139]", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1066265139,v1:127.0.0.1:6817/1066265139]", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1066265139,v1:127.0.0.1:6815/1066265139]", 2026-02-13T09:45:00.283 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/1124534624,v1:127.0.0.1:6813/1124534624]", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:45:00.284 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:45:00.285 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:43:57.096331Z", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/1124534624,v1:127.0.0.1:6811/1124534624]", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1124534624,v1:127.0.0.1:6817/1124534624]", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1124534624,v1:127.0.0.1:6815/1124534624]", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:45:00.286 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_clean_epochs": { 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "min_last_epoch_clean": 0, 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": { 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "per_pool": [] 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "osd_epochs": [ 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 35 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 39 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_first_committed": 1, 2026-02-13T09:45:00.287 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_last_committed": 44, 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "crushmap": { 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "devices": [ 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.0", 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.1", 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.2", 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "types": [ 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 0, 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd" 2026-02-13T09:45:00.288 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "name": "host" 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 2, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "name": "chassis" 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 3, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "name": "rack" 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 4, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "name": "row" 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 5, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pdu" 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.289 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 6, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pod" 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 7, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "name": "room" 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 8, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "name": "datacenter" 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 9, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "name": "zone" 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 10, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: "name": "region" 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.290 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.291 INFO:tasks.workunit.client.0.trial010.stderr:report 294138677 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: "name": "root" 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: "buckets": [ 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: "id": -1, 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default", 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:45:00.292 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.293 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "id": -2, 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default~ssd", 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.294 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010", 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.295 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010~ssd", 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.296 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "rules": [ 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 0, 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "replicated_rule", 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_firstn", 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.297 INFO:tasks.workunit.client.0.trial010.stdout: "tunables": { 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_tries": 0, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_fallback_tries": 0, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "choose_total_tries": 50, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_descend_once": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_vary_r": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_stable": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "msr_descents": 100, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "msr_collision_tries": 100, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "straw_calc_version": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "allowed_bucket_algs": 54, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "profile": "jewel", 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_tunables": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "legacy_tunables": 0, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "minimum_required_version": "jewel", 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables2": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "has_v2_rules": 0, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables3": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "has_v3_rules": 0, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "has_v4_buckets": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables5": 1, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "has_v5_rules": 0, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "has_msr_rules": 0 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.298 INFO:tasks.workunit.client.0.trial010.stdout: "choose_args": {} 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "fsmap": { 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "btime": "2026-02-13T09:43:49:690680+0000", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "default_fscid": -1, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "compat": { 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "compat": {}, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "ro_compat": {}, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "incompat": { 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_1": "base v0.20", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_2": "client writeable ranges", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_4": "dir inode in separate object", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_8": "no anchor table", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_9": "file layout v2", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_10": "snaprealm v2", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_11": "minor log segments", 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "feature_flags": { 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "enable_multiple": true, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "ever_enabled_multiple": true 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.299 INFO:tasks.workunit.client.0.trial010.stdout: "standbys": [], 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "filesystems": [] 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_first_committed": 1, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_last_committed": 1, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "auth": { 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 5, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_secrets": 3 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 32, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_active": 32, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_unknown": 0, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_osd": 3, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "pool_sum": { 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51200, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:45:00.300 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 100, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 100, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:45:00.301 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 512, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 512, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "up": 64, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 64, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 0 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum": { 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 34, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:45:00.302 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83928, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2144, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 28, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81699, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488872, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036604928, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2195456, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 451474, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 29315, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83660157 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:45:00.303 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum_by_class": { 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "ssd": { 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 34, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83928, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2144, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 28, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81699, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488872, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036604928, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2195456, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 451474, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 29315, 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83660157 2026-02-13T09:45:00.304 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "pool_stats": [ 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 32, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51200, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:45:00.305 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 100, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 100, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:45:00.306 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 1220608, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 153552, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 512, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 512, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "up": 64, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 64, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 3 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "osd_stats": [ 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 150323855369 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 38654705676 2026-02-13T09:45:00.307 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 163208757257 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_state": [ 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded", 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "num": 31 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded+wait", 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "num": 1 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "pool_pg_unavailable_map": [ 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": "1", 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "pgs": [] 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_osd": [ 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 32, 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:45:00.308 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 32, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 32, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 0, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": [ 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": {} 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "servicemap": { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 3, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:44:58.090063+0000", 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "services": { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "osd": { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "daemons": { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "summary": "", 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "0": { 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:45:00.309 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "2": { 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_first_committed": 1, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_last_committed": 36, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "logm_first_committed": 1, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "logm_last_committed": 219, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "paxos": { 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 309, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "last_pn": 0, 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: "accepted_pn": 0 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:00.310 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:45:00.311 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T09:45:00.311 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: expr 2 + 2 2026-02-13T09:45:00.311 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:755: TEST_divergent_3: objname=existing_4 2026-02-13T09:45:00.311 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:756: TEST_divergent_3: echo 'writing non-divergent object existing_4' 2026-02-13T09:45:00.311 INFO:tasks.workunit.client.0.trial010.stdout:writing non-divergent object existing_4 2026-02-13T09:45:00.311 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:757: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253354+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254772+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254262+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256428+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254203+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254852+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253245+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256464+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256493+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256528+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256625+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254171+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254320+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256284+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256594+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253361+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.452 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded+wait 2026-02-13T09:44:54.248707+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256559+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256881+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256338+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252904+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253211+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252551+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253251+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253753+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253792+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253886+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253722+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.255723+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253315+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253019+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253054+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:00.453 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:00.461 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:758: TEST_divergent_3: rados -p test put existing_4 /tmp/tmp.9n2wfChXp0 2026-02-13T09:45:00.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:45:00.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:760: TEST_divergent_3: wait_for_clean 2026-02-13T09:45:00.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:45:00.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:45:00.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:45:00.485 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:45:00.485 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:45:00.485 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:45:00.485 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:45:00.485 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:45:00.485 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:45:00.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:45:00.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:45:00.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:45:00.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:45:00.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:45:00.556 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:45:00.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:45:00.771 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:45:00.771 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:45:00.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:45:00.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:45:00.772 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:45:00.854 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855371 2026-02-13T09:45:00.854 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855371 2026-02-13T09:45:00.854 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855371' 2026-02-13T09:45:00.854 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:45:00.854 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:45:00.913 INFO:tasks.workunit.client.0.trial010.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-13T09:45:00.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T09:45:00.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T09:45:00.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T09:45:00.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:45:00.916 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:45:00.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757259 2026-02-13T09:45:00.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757259 2026-02-13T09:45:00.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-150323855371 2-163208757259' 2026-02-13T09:45:00.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:45:00.998 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-150323855371 2026-02-13T09:45:00.998 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:45:00.999 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:45:01.000 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-150323855371 2026-02-13T09:45:01.000 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:45:01.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855371 2026-02-13T09:45:01.001 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 150323855371 2026-02-13T09:45:01.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 150323855371' 2026-02-13T09:45:01.002 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:45:01.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855369 -lt 150323855371 2026-02-13T09:45:01.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:45:02.219 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:45:02.220 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:45:02.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855371 -lt 150323855371 2026-02-13T09:45:02.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:45:02.442 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757259 2026-02-13T09:45:02.442 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:45:02.443 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:45:02.444 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757259 2026-02-13T09:45:02.444 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:45:02.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757259 2026-02-13T09:45:02.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757259' 2026-02-13T09:45:02.446 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 163208757259 2026-02-13T09:45:02.446 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:45:02.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757259 -lt 163208757259 2026-02-13T09:45:02.672 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:45:02.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:02.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:02.960 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 32 == 0 2026-02-13T09:45:02.960 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:02.961 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:02.961 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:02.962 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:02.962 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:02.962 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:02.962 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:03.178 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:03.178 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:03.179 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:03.179 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:03.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:03.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T09:45:03.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T09:45:03.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T09:45:03.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:03.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T09:45:03.567 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:03.567 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:03.568 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:03.790 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:03.790 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:03.791 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:03.791 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:04.078 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:04.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:04.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:04.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:04.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:04.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:04.079 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:04.079 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:04.080 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:04.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:04.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:04.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T09:45:04.358 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:04.358 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T09:45:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:04.559 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:04.559 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:04.559 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:04.559 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:04.559 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:04.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:04.777 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:04.777 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:04.778 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:04.778 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:05.067 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:05.068 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:05.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:05.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:05.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T09:45:05.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:05.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T09:45:05.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:05.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:05.751 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:05.752 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:05.752 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:05.752 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:05.752 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:05.752 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:05.969 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:05.970 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:05.970 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:05.971 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:06.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:06.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:06.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:06.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:06.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:06.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:06.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:06.267 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:06.267 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:06.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:06.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:06.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T09:45:06.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:06.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T09:45:07.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:07.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:07.358 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:07.358 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:07.358 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:07.358 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:07.358 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:07.358 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:07.572 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:07.573 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:07.573 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:07.573 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:07.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:07.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:07.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:07.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:07.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:07.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:07.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:07.865 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:07.865 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:08.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:08.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:08.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T09:45:08.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:08.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T09:45:09.756 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:09.756 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:09.757 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:09.757 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:09.757 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:09.757 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:09.757 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:09.757 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:09.973 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:09.973 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:09.973 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:09.974 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:10.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:10.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:10.268 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:10.268 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:10.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:10.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:10.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T09:45:10.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:10.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T09:45:13.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:13.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:13.758 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:13.758 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:13.758 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:13.759 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:13.759 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:13.759 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:13.974 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:13.974 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:13.975 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:13.975 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:14.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:14.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:14.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:14.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:14.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:14.264 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:14.264 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:14.264 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:14.264 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:14.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:14.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:14.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T09:45:14.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:14.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T09:45:20.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:20.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:20.946 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:20.947 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:20.947 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:20.947 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:20.947 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:20.947 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:21.158 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:21.159 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:21.159 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:21.159 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:21.455 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:21.455 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:21.455 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:21.455 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:21.455 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:21.455 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:21.456 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:21.456 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:21.456 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:21.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:21.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:21.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T09:45:21.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:45:21.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T09:45:29.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:45:29.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:45:29.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:45:29.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:45:29.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:45:29.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:45:29.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:45:29.044 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:45:29.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:45:29.253 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:45:29.254 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:45:29.254 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:45:29.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 32 2026-02-13T09:45:29.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:45:29.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:45:29.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:45:29.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:45:29.532 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:45:29.532 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:45:29.532 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:45:29.532 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:45:29.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:45:29.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:45:29.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T09:45:29.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T09:45:30.079 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_fingerprint": "f8a62dcf-3e9f-4c5b-a322-5f105d56e1db", 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "version": "20.2.0-636-g3b40640f", 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "commit": "3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb", 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "timestamp": "2026-02-13T09:45:30.077384+0000", 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "tag": "", 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "health": { 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "status": "HEALTH_WARN", 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "checks": { 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "OSDMAP_FLAGS": { 2026-02-13T09:45:30.080 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "count": 17 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [], 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "OSD_DOWN": { 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "message": "1 osds down", 2026-02-13T09:45:30.081 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: "message": "osd.1 (root=default,host=trial010) is down" 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: "PG_DEGRADED": { 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:45:30.082 INFO:tasks.workunit.client.0.trial010.stdout: "message": "Degraded data redundancy: 100/300 objects degraded (33.333%), 32 pgs degraded", 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: "count": 32 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.083 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.2 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.3 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.4 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.5 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.084 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.6 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.7 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.8 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.9 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.085 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.a is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.b is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.c is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.d is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.086 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.e is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.f is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.10 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.11 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.12 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.087 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.13 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.14 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.15 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.16 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.088 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.17 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.18 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.19 is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1a is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.089 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1b is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1c is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1d is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1e is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.090 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.1f is active+undersized+degraded, acting [0,2]" 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: "mutes": [] 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_first_committed": 1, 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_last_committed": 1, 2026-02-13T09:45:30.091 INFO:tasks.workunit.client.0.trial010.stdout: "monmap": { 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:43:49.603644Z", 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:43:49.603644Z", 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release": 20, 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release_name": "tentacle", 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "election_strategy": 1, 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "disallowed_leaders": "", 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": false, 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "tiebreaker_mon": "", 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "removed_ranks": "", 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "features": { 2026-02-13T09:45:30.092 INFO:tasks.workunit.client.0.trial010.stdout: "persistent": [ 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "kraken", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "luminous", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "mimic", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap-prune", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "nautilus", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "octopus", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "pacific", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "elector-pinging", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "quincy", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "reef", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "squid", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "tentacle", 2026-02-13T09:45:30.093 INFO:tasks.workunit.client.0.trial010.stdout: "nvmeof_beacon_diff" 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "optional": [] 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "mons": [ 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "rank": 0, 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "name": "a", 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.094 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115", 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 0 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: "priority": 0, 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 0, 2026-02-13T09:45:30.095 INFO:tasks.workunit.client.0.trial010.stdout: "crush_location": "{}" 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: "quorum": [ 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: 0 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap": { 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 44, 2026-02-13T09:45:30.096 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:43:49.690915+0000", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:44:54.241862+0000", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "last_up_change": "2026-02-13T09:44:29.723673+0000", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "last_in_change": "2026-02-13T09:44:30.606397+0000", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "flags_num": 5800384, 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "flags_set": [ 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "nodown", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "noin", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "noout", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "pglog_hardlimit", 2026-02-13T09:45:30.097 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snapdirs", 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "recovery_deletes", 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "sortbitwise" 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "crush_version": 9, 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_snapshot": "", 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "pool_max": 1, 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "max_osd": 3, 2026-02-13T09:45:30.098 INFO:tasks.workunit.client.0.trial010.stdout: "require_min_compat_client": "luminous", 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "min_compat_client": "jewel", 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "require_osd_release": "tentacle", 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "allow_crimson": false, 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "pools": [ 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "pool_name": "test", 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "create_time": "2026-02-13T09:44:00.241411+0000", 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "flags": 1, 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "flags_names": "hashpspool", 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:45:30.099 INFO:tasks.workunit.client.0.trial010.stdout: "size": 3, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "min_size": 2, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "crush_rule": 0, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_count": 0, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_target": 0, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "is_stretch_pool": false, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "object_hash": 2, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "pg_autoscale_mode": "on", 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num": 32, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num": 1, 2026-02-13T09:45:30.100 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num_target": 32, 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_target": 32, 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_pending": 32, 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "last_pg_merge_meta": { 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "source_pgid": "0.0", 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "ready_epoch": 0, 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_started": 0, 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": 0, 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "source_version": "0'0", 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "target_version": "0'0" 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "last_change": "43", 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend": "0", 2026-02-13T09:45:30.101 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_preluminous": "43", 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "auid": 0, 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "snap_mode": "selfmanaged", 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "snap_seq": 0, 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "snap_epoch": 0, 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "pool_snaps": [], 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps": "[]", 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_bytes": 0, 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_objects": 0, 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "tiers": [], 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "tier_of": -1, 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "read_tier": -1, 2026-02-13T09:45:30.102 INFO:tasks.workunit.client.0.trial010.stdout: "write_tier": -1, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "cache_mode": "none", 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_bytes": 0, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_objects": 0, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_flush_age": 0, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_evict_age": 0, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profile": "", 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_params": { 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "type": "none" 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.103 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_period": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_count": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "use_gmt_hitset": true, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "min_read_recency_for_promote": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "min_write_recency_for_promote": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_search_last_n": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "grade_table": [], 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "stripe_width": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "expected_num_objects": 0, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "fast_read": false, 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "nonprimary_shards": "{}", 2026-02-13T09:45:30.104 INFO:tasks.workunit.client.0.trial010.stdout: "options": {}, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "application_metadata": {}, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "read_balance": { 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "score_type": "Fair distribution", 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "score_acting": 2.9900000095367432, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "score_stable": 2.9900000095367432, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_score": 0.67000001668930054, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_acting": 2, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "raw_score_stable": 2, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity_weighted": 1, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity": 1, 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: "average_primary_affinity_weighted": 1 2026-02-13T09:45:30.105 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "osds": [ 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "2bcc8785-bfeb-4753-a151-9e8180ff3494", 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 5, 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 28, 2026-02-13T09:45:30.106 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 35, 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 43, 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 29, 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6800", 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.107 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6801", 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6802", 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.108 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6803", 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.109 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6806", 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6807", 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.110 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6804", 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6805", 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 2558892804 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.111 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6801/2558892804", 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6803/2558892804", 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6807/2558892804", 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6805/2558892804", 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "209f01a6-87a6-4e35-bcc3-5d15d67f5e67", 2026-02-13T09:45:30.112 INFO:tasks.workunit.client.0.trial010.stdout: "up": 0, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 0, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 0, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 9, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 20, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 30, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.113 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:45:30.114 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:45:30.115 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.116 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1066265139 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.117 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/1066265139", 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/1066265139", 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1066265139", 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1066265139", 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "exists" 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "25739b1b-5ac0-4c55-a098-a8ff66bc52a1", 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:45:30.118 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 13, 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 28, 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 38, 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 0, 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 31, 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.119 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.120 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.121 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1124534624 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/1124534624", 2026-02-13T09:45:30.122 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/1124534624", 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1124534624", 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1124534624", 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "osd_xinfo": [ 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:44:25.398563+0000", 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:45:30.123 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:43:52.950371+0000", 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:44:25.683353+0000", 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:30.124 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:44:25.963411+0000", 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:43:59.591972+0000", 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap": [], 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_items": [], 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_primaries": [], 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "pg_temp": [], 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "primary_temp": [], 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "blocklist": {}, 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "range_blocklist": {}, 2026-02-13T09:45:30.125 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profiles": { 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "default": { 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "m": "2", 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps_queue": [], 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "new_removed_snaps": [], 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "new_purged_snaps": [], 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "crush_node_flags": {}, 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "device_class_flags": {}, 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": { 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_enabled": false, 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_bucket_count": 0, 2026-02-13T09:45:30.126 INFO:tasks.workunit.client.0.trial010.stdout: "degraded_stretch_mode": 0, 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "recovering_stretch_mode": 0, 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_bucket": 0 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "osd_metadata": [ 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6802/2558892804,v1:127.0.0.1:6803/2558892804]", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:45:30.127 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:43:50.662176Z", 2026-02-13T09:45:30.128 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6800/2558892804,v1:127.0.0.1:6801/2558892804]", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/2558892804,v1:127.0.0.1:6807/2558892804]", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/2558892804,v1:127.0.0.1:6805/2558892804]", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:45:30.129 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/1066265139,v1:127.0.0.1:6813/1066265139]", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:45:30.130 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:43:54.256618Z", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:45:30.131 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/1066265139,v1:127.0.0.1:6811/1066265139]", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1066265139,v1:127.0.0.1:6817/1066265139]", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1066265139,v1:127.0.0.1:6815/1066265139]", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:45:30.132 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/1124534624,v1:127.0.0.1:6813/1124534624]", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:45:30.133 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:43:57.096331Z", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/1124534624,v1:127.0.0.1:6811/1124534624]", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1124534624,v1:127.0.0.1:6817/1124534624]", 2026-02-13T09:45:30.134 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1124534624,v1:127.0.0.1:6815/1124534624]", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_clean_epochs": { 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "min_last_epoch_clean": 0, 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": { 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "per_pool": [] 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.135 INFO:tasks.workunit.client.0.trial010.stdout: "osd_epochs": [ 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 35 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 39 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_first_committed": 1, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_last_committed": 44, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "crushmap": { 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "devices": [ 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.0", 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:30.136 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.1", 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.2", 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "types": [ 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 0, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd" 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "name": "host" 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 2, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: "name": "chassis" 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.137 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 3, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "name": "rack" 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 4, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "name": "row" 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 5, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pdu" 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 6, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pod" 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 7, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "name": "room" 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 8, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: "name": "datacenter" 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.138 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 9, 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: "name": "zone" 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 10, 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: "name": "region" 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stderr:report 3786497567 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:45:30.139 INFO:tasks.workunit.client.0.trial010.stdout: "name": "root" 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "buckets": [ 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "id": -1, 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default", 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "id": -2, 2026-02-13T09:45:30.140 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default~ssd", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:30.141 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010~ssd", 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.142 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "rules": [ 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 0, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "replicated_rule", 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:45:30.143 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_firstn", 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "tunables": { 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_tries": 0, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_fallback_tries": 0, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "choose_total_tries": 50, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_descend_once": 1, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_vary_r": 1, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_stable": 1, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "msr_descents": 100, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "msr_collision_tries": 100, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "straw_calc_version": 1, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "allowed_bucket_algs": 54, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "profile": "jewel", 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_tunables": 1, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "legacy_tunables": 0, 2026-02-13T09:45:30.144 INFO:tasks.workunit.client.0.trial010.stdout: "minimum_required_version": "jewel", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables": 1, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables2": 1, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "has_v2_rules": 0, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables3": 1, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "has_v3_rules": 0, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "has_v4_buckets": 1, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables5": 1, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "has_v5_rules": 0, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "has_msr_rules": 0 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "choose_args": {} 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "fsmap": { 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "btime": "2026-02-13T09:43:49:690680+0000", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "default_fscid": -1, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "compat": { 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "compat": {}, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "ro_compat": {}, 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "incompat": { 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_1": "base v0.20", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_2": "client writeable ranges", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_4": "dir inode in separate object", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_8": "no anchor table", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_9": "file layout v2", 2026-02-13T09:45:30.145 INFO:tasks.workunit.client.0.trial010.stdout: "feature_10": "snaprealm v2", 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "feature_11": "minor log segments", 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "feature_flags": { 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "enable_multiple": true, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "ever_enabled_multiple": true 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "standbys": [], 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "filesystems": [] 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_first_committed": 1, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_last_committed": 1, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "auth": { 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 5, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_secrets": 3 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 32, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_active": 32, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_unknown": 0, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_osd": 3, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "pool_sum": { 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51688, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:45:30.146 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:45:30.147 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 513, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 513, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "up": 64, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 64, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 0 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum": { 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:45:30.148 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 65, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83928, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2144, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 28, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81699, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488872, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036604928, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2195456, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 452450, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 29315, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83660157 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.149 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum_by_class": { 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "ssd": { 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 65, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83928, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2144, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 28, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81699, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488872, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036604928, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2195456, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 452450, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:30.150 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 29315, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83660157 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "pool_stats": [ 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 32, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 51688, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 100, 2026-02-13T09:45:30.151 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 300, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 100, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 100, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:45:30.152 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 1220608, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 154528, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 513, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 513, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "up": 64, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 64, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 3 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "osd_stats": [ 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 150323855377 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.153 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 38654705676 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 163208757264 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_state": [ 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded", 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num": 32 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "pool_pg_unavailable_map": [ 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": "1", 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "pgs": [] 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_osd": [ 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 32, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 32, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 32, 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:45:30.154 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 0, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": [ 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": {} 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "servicemap": { 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 4, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:45:28.094648+0000", 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "services": { 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "osd": { 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "daemons": { 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "summary": "", 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "2": { 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.155 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_first_committed": 1, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_last_committed": 50, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "logm_first_committed": 1, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "logm_last_committed": 281, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "paxos": { 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 385, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "last_pn": 0, 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: "accepted_pn": 0 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:763: TEST_divergent_3: echo 'delay recovery' 2026-02-13T09:45:30.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:764: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:30.297 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:30.297 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253354+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.297 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254772+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.297 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254262+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.297 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256428+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254203+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254852+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253245+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256464+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256493+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256528+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256625+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254171+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254320+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256284+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256594+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253361+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:45:02.713384+0000 28'100 44:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:45:55.946739+0000 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256559+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:44:54.256881+0000 44'101 44:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256338+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252904+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253211+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252551+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253251+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253753+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253792+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.298 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253886+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253722+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.255723+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253315+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253019+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253054+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:30.299 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:30.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:45:30.307 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.0 2026-02-13T09:45:30.307 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:45:30.307 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:45:30.308 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:45:30.308 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:45:30.308 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:45:30.308 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:45:30.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-13T09:45:30.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T09:45:30.372 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:45:30.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:765: TEST_divergent_3: for i in $non_divergent 2026-02-13T09:45:30.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: get_asok_path osd.2 2026-02-13T09:45:30.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:45:30.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:45:30.380 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:45:30.380 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:45:30.380 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:45:30.381 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:45:30.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: CEPH_ARGS= 2026-02-13T09:45:30.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:767: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T09:45:30.444 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:45:30.450 INFO:tasks.workunit.client.0.trial010.stdout:revive divergent 1 2026-02-13T09:45:30.450 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:771: TEST_divergent_3: echo 'revive divergent 1' 2026-02-13T09:45:30.450 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:772: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:30.668 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:30.668 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253354+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254772+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254262+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256428+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254203+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254852+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253245+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256464+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256493+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256528+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.669 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256625+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254171+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254320+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256284+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256594+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253361+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:45:02.713384+0000 28'100 44:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:45:55.946739+0000 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256559+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:44:54.256881+0000 44'101 44:145 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256338+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252904+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253211+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.670 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252551+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253251+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253753+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253792+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253886+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253722+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.255723+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253315+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253019+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253054+0000 28'100 44:144 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:30.671 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:30.672 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:30.677 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:773: TEST_divergent_3: ceph osd set noup 2026-02-13T09:45:31.007 INFO:tasks.workunit.client.0.trial010.stderr:noup is set 2026-02-13T09:45:31.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:774: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-13T09:45:31.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:45:31.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:45:31.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:45:31.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:45:31.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:45:31.025 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:45:31.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:45:31.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:45:31.027 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:45:31.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:45:31.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:45:31.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:45:31.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:45:31.041 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:31.035+0000 7f21bf60fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:45:31.043 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:31.039+0000 7f21bf60fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:45:31.044 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:31.039+0000 7f21bf60fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:45:31.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T09:45:31.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:775: TEST_divergent_3: sleep 5 2026-02-13T09:45:31.428 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:31.423+0000 7f21bf60fa40 -1 Falling back to public interface 2026-02-13T09:45:32.065 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:32.059+0000 7f21bf60fa40 -1 osd.1 28 log_to_monitors true 2026-02-13T09:45:36.250 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery divergent 2026-02-13T09:45:36.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:777: TEST_divergent_3: echo 'delay recovery divergent' 2026-02-13T09:45:36.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:778: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253354+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:15.040774+0000 0 0 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254772+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254262+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256428+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254203+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254852+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.453 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253245+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:19.082858+0000 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256464+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256493+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256528+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256625+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254171+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:25.074436+0000 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254320+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256284+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256594+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253361+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:11.973726+0000 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:45:02.713384+0000 28'100 47:151 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:45:55.946739+0000 0 0 2026-02-13T09:45:36.454 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256559+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:44:54.256881+0000 44'101 47:151 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256338+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252904+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:05.898895+0000 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253211+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:07.917990+0000 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252551+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:00.954962+0000 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253251+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253753+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:21.091726+0000 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253792+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:30.001984+0000 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253886+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:22.077418+0000 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253722+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:18.079105+0000 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.255723+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.455 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253315+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.456 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253019+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:36.456 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253054+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:06.877329+0000 0 0 2026-02-13T09:45:36.456 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:36.456 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:36.456 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:36.463 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: get_asok_path osd.1 2026-02-13T09:45:36.464 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:45:36.464 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:45:36.465 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:45:36.465 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:45:36.465 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:45:36.465 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:45:36.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: CEPH_ARGS= 2026-02-13T09:45:36.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:779: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T09:45:36.530 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:45:36.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:781: TEST_divergent_3: ceph osd unset noup 2026-02-13T09:45:36.859 INFO:tasks.workunit.client.0.trial010.stderr:noup is unset 2026-02-13T09:45:36.871 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:783: TEST_divergent_3: wait_for_osd up 0 2026-02-13T09:45:36.871 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:45:36.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:45:36.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:45:36.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:45:36.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:45:36.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:45:36.872 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:45:36.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:45:36.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:45:37.084 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 35 up_thru 43 down_at 29 last_clean_interval [5,28) [v2:127.0.0.1:6800/2558892804,v1:127.0.0.1:6801/2558892804] [v2:127.0.0.1:6802/2558892804,v1:127.0.0.1:6803/2558892804] exists,up 2bcc8785-bfeb-4753-a151-9e8180ff3494 2026-02-13T09:45:37.085 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:784: TEST_divergent_3: wait_for_osd up 1 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:45:37.086 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:45:37.087 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:45:37.087 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:45:37.087 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:45:37.087 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:45:37.306 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/395576255,v1:127.0.0.1:6819/395576255] [v2:127.0.0.1:6820/395576255,v1:127.0.0.1:6821/395576255] exists,up 209f01a6-87a6-4e35-bcc3-5d15d67f5e67 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:785: TEST_divergent_3: wait_for_osd up 2 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:45:37.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:45:37.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:45:37.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:45:37.309 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:45:37.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:45:37.310 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:45:37.523 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 38 up_thru 0 down_at 31 last_clean_interval [13,28) [v2:127.0.0.1:6810/1124534624,v1:127.0.0.1:6811/1124534624] [v2:127.0.0.1:6812/1124534624,v1:127.0.0.1:6813/1124534624] exists,up 25739b1b-5ac0-4c55-a098-a8ff66bc52a1 2026-02-13T09:45:37.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:45:37.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:45:37.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:45:37.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:787: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:37.736 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:37.736 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253354+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:15.040774+0000 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254772+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254262+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256428+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254203+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254852+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253245+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:19.082858+0000 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256464+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256493+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256528+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.737 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256625+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254171+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:25.074436+0000 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254320+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256284+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256594+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253361+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:11.973726+0000 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:45:02.713384+0000 28'100 47:151 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:45:55.946739+0000 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256559+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:44:54.256881+0000 44'101 47:151 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256338+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.738 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252904+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:05.898895+0000 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253211+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:07.917990+0000 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252551+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:00.954962+0000 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253251+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253753+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:21.091726+0000 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253792+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:30.001984+0000 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253886+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:22.077418+0000 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253722+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:18.079105+0000 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.255723+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253315+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253019+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.739 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253054+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:06.877329+0000 0 0 2026-02-13T09:45:37.740 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:37.740 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:37.740 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:37.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:788: TEST_divergent_3: echo 'wait for peering' 2026-02-13T09:45:37.746 INFO:tasks.workunit.client.0.trial010.stdout:wait for peering 2026-02-13T09:45:37.746 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:789: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:37.968 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:37.968 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253354+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:15.040774+0000 0 0 2026-02-13T09:45:37.968 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254772+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.968 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254262+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.968 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256428+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.968 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254203+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.968 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254852+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253245+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:19.082858+0000 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256464+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256493+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256528+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256625+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254171+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:25.074436+0000 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.254320+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256284+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 4 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256594+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253361+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:11.973726+0000 0 0 2026-02-13T09:45:37.969 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:45:02.713384+0000 28'100 47:151 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:45:55.946739+0000 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256559+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 3 0 0 2088 0 0 17 84 17 active+undersized+degraded 2026-02-13T09:44:54.256881+0000 44'101 47:151 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.256338+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252904+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:05.898895+0000 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253211+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:07.917990+0000 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.252551+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:00.954962+0000 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253251+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253753+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:21.091726+0000 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253792+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:30.001984+0000 0 0 2026-02-13T09:45:37.970 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253886+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:22.077418+0000 0 0 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253722+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:18.079105+0000 0 0 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.255723+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253315+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253019+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 3 0 0 1600 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:44:54.253054+0000 28'100 47:150 [0,2] 0 [0,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 user requested scrub scheduled @ 2026-02-13T09:46:06.877329+0000 0 0 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:37.971 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:37.977 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:790: TEST_divergent_3: rados -p test put foo /tmp/tmp.YUyNCzI43p 2026-02-13T09:45:38.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:791: TEST_divergent_3: rm -f /tmp/tmp.YUyNCzI43p 2026-02-13T09:45:38.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:792: TEST_divergent_3: rm -f /tmp/tmp.9n2wfChXp0 2026-02-13T09:45:38.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:796: TEST_divergent_3: echo 'killing divergent 1' 2026-02-13T09:45:38.025 INFO:tasks.workunit.client.0.trial010.stdout:killing divergent 1 2026-02-13T09:45:38.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:797: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:38.235 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861506+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861535+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861274+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866465+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.861537+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.861547+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.861458+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866332+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866357+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.236 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866337+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866516+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866515+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866305+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866386+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866303+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861226+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861685+0000 28'106 49:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866514+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866460+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866277+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.859619+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.237 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860347+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860448+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860530+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861366+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861466+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861413+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861449+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.859659+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.859690+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.859625+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860536+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:38.238 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:38.239 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:38.244 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:798: TEST_divergent_3: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T09:45:38.245 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:45:38.245 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:45:38.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:45:38.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:45:38.245 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:45:38.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:45:38.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:801: TEST_divergent_3: expfile=td/divergent-priors/exp.16079.out 2026-02-13T09:45:38.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:802: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16079.out 2026-02-13T09:45:38.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T09:45:38.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T09:45:38.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T09:45:38.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T09:45:38.355 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T09:45:38.355 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op export-remove --pgid 1.0 --file td/divergent-priors/exp.16079.out 2026-02-13T09:45:38.530 INFO:tasks.workunit.client.0.trial010.stderr:Exporting 1.0 info 1.0( v 28'100 (28'90,28'100] local-lis/les=49/51 n=3 ec=20/20 lis/c=49/49 les/c/f=51/51/0 sis=49) 2026-02-13T09:45:38.532 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:023dd3d2:::existing_12:head# 2026-02-13T09:45:38.532 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:04c40a0c:::existing_93:head# 2026-02-13T09:45:38.532 INFO:tasks.workunit.client.0.trial010.stderr:Read #1:064ff5fb:::existing_36:head# 2026-02-13T09:45:38.532 INFO:tasks.workunit.client.0.trial010.stderr:Export successful 2026-02-13T09:45:38.532 INFO:tasks.workunit.client.0.trial010.stdout: marking collection for removal 2026-02-13T09:45:38.533 INFO:tasks.workunit.client.0.trial010.stdout:setting '_remove' omap key 2026-02-13T09:45:38.533 INFO:tasks.workunit.client.0.trial010.stdout:finish_remove_pgs 1.0_head removing 1.0 2026-02-13T09:45:38.533 INFO:tasks.workunit.client.0.trial010.stderr:Remove successful 2026-02-13T09:45:38.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:803: TEST_divergent_3: _objectstore_tool_nodown td/divergent-priors 1 --op import --file td/divergent-priors/exp.16079.out 2026-02-13T09:45:38.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T09:45:38.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T09:45:38.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T09:45:38.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T09:45:38.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T09:45:38.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op import --file td/divergent-priors/exp.16079.out 2026-02-13T09:45:38.806 INFO:tasks.workunit.client.0.trial010.stdout:get_pg_num_history pg_num_history pg_num_history(e51 pg_nums {1={20=1,43=32}} deleted_pools ) 2026-02-13T09:45:38.806 INFO:tasks.workunit.client.0.trial010.stdout:Importing pgid 1.0 2026-02-13T09:45:38.806 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:023dd3d2:::existing_12:head# 2026-02-13T09:45:38.807 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:45:38.807 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:04c40a0c:::existing_93:head# 2026-02-13T09:45:38.807 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:45:38.807 INFO:tasks.workunit.client.0.trial010.stdout:Write #1:064ff5fb:::existing_36:head# 2026-02-13T09:45:38.807 INFO:tasks.workunit.client.0.trial010.stdout:snapset 0={} 2026-02-13T09:45:38.807 INFO:tasks.workunit.client.0.trial010.stdout:write_pg epoch 51 info 1.0( v 28'100 (28'90,28'100] local-lis/les=49/51 n=3 ec=20/20 lis/c=49/49 les/c/f=51/51/0 sis=49) 2026-02-13T09:45:38.807 INFO:tasks.workunit.client.0.trial010.stdout:Import successful 2026-02-13T09:45:38.902 INFO:tasks.workunit.client.0.trial010.stdout:reviving divergent 1 2026-02-13T09:45:38.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:805: TEST_divergent_3: echo 'reviving divergent 1' 2026-02-13T09:45:38.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:806: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:45:39.104 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861506+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861535+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861274+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866465+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.861537+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.861547+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.861458+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866332+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.6 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866357+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866337+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.105 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866516+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866515+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866305+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866386+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866303+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861226+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861685+0000 28'106 49:131 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866514+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866460+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.866277+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 0 0 0 1599 0 0 16 90 16 peering 2026-02-13T09:45:36.859619+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.106 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860347+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860448+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860530+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861366+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861466+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.16 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861413+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.861449+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.859659+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.19 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.859690+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.859625+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 0 0 0 1598 0 0 16 90 16 peering 2026-02-13T09:45:36.860536+0000 28'106 50:132 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:45:39.107 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:45:39.108 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:807: TEST_divergent_3: activate_osd td/divergent-priors 1 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:45:39.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:45:39.117 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:45:39.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:45:39.119 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:45:39.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:45:39.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:45:39.120 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:45:39.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:45:39.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:45:39.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:45:39.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:45:39.143 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:39.139+0000 7f3bc55dca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:45:39.144 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:39.139+0000 7f3bc55dca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:45:39.145 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:39.139+0000 7f3bc55dca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:45:39.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:45:39.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:45:39.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:45:39.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:45:39.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:45:39.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:45:39.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:45:39.336 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:45:39.337 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:45:39.337 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:45:39.554 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/395576255,v1:127.0.0.1:6819/395576255] [v2:127.0.0.1:6820/395576255,v1:127.0.0.1:6821/395576255] exists,up 209f01a6-87a6-4e35-bcc3-5d15d67f5e67 2026-02-13T09:45:39.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:45:39.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:45:39.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:45:39.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:808: TEST_divergent_3: wait_for_osd up 1 2026-02-13T09:45:39.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:45:39.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:45:39.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:45:39.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:45:39.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:45:39.556 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:45:39.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:45:39.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:45:39.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:45:39.557 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:39.551+0000 7f3bc55dca40 -1 Falling back to public interface 2026-02-13T09:45:39.771 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 49 up_thru 49 down_at 30 last_clean_interval [9,28) [v2:127.0.0.1:6818/395576255,v1:127.0.0.1:6819/395576255] [v2:127.0.0.1:6820/395576255,v1:127.0.0.1:6821/395576255] exists,up 209f01a6-87a6-4e35-bcc3-5d15d67f5e67 2026-02-13T09:45:39.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:45:39.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:45:39.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:45:39.773 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:810: TEST_divergent_3: sleep 20 2026-02-13T09:45:40.229 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:45:40.223+0000 7f3bc55dca40 -1 osd.1 51 log_to_monitors true 2026-02-13T09:45:59.775 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: get_asok_path osd.1 2026-02-13T09:45:59.775 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:45:59.775 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:45:59.775 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:45:59.776 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:45:59.776 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:45:59.776 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:45:59.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: CEPH_ARGS= 2026-02-13T09:45:59.776 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:811: TEST_divergent_3: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.1.asok dump_ops_in_flight 2026-02-13T09:45:59.830 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:45:59.831 INFO:tasks.workunit.client.0.trial010.stdout: "ops": [], 2026-02-13T09:45:59.831 INFO:tasks.workunit.client.0.trial010.stdout: "num_ops": 0 2026-02-13T09:45:59.831 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:45:59.836 INFO:tasks.workunit.client.0.trial010.stdout:allowing recovery 2026-02-13T09:45:59.837 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:813: TEST_divergent_3: echo 'allowing recovery' 2026-02-13T09:45:59.837 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:814: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.256213+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-13T09:45:49.140575+0000 28'100 61:177 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-13T09:45:49.140533+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:16:53.632647+0000 3 0 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257300+0000 28'100 63:149 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:54.363480+0000 28'100 63:182 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-13T09:45:54.363439+0000 0'0 2026-02-13T09:44:00.268472+0000 0 1 periodic scrub scheduled @ 2026-02-14T12:07:01.536084+0000 3 0 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256738+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257807+0000 28'100 63:149 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:49.258598+0000 28'100 63:185 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-13T09:45:49.258559+0000 0'0 2026-02-13T09:44:00.268472+0000 0 1 periodic scrub scheduled @ 2026-02-14T12:18:22.530199+0000 3 0 2026-02-13T09:46:00.052 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.255933+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-13T09:45:48.257133+0000 51'101 61:161 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257823+0000 28'100 63:149 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:40.630734+0000 28'100 63:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:50.255898+0000 28'100 63:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256984+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-13T09:45:40.631715+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.1 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257836+0000 28'100 63:149 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:40.630202+0000 28'100 63:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:46.267223+0000 28'100 63:184 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-13T09:45:46.267183+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T18:52:03.974021+0000 3 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257911+0000 28'100 63:149 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.053 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-13T09:45:48.256894+0000 44'101 61:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.255766+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:45.306064+0000 28'100 63:185 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-13T09:45:45.306013+0000 0'0 2026-02-13T09:44:00.268472+0000 0 1 periodic scrub scheduled @ 2026-02-14T18:16:03.587569+0000 3 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257116+0000 28'100 63:149 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256990+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:50.256594+0000 28'100 63:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:40.631541+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257152+0000 28'100 63:149 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.16 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-13T09:45:50.100287+0000 28'100 61:177 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-13T09:45:50.100234+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T10:46:34.170613+0000 4 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.256151+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:40.628314+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-13T09:45:49.790286+0000 28'100 63:157 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-13T09:45:49.790228+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:22:53.046656+0000 2 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256746+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-13T09:45:41.310022+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.054 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:50.256357+0000 28'100 63:175 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-13T09:45:47.799601+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.055 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:46:00.055 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:46:00.055 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:00.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-13T09:46:00.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T09:46:00.148 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:46:00.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-13T09:46:00.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T09:46:00.229 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:46:00.236 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:816: TEST_divergent_3: for i in $osds 2026-02-13T09:46:00.236 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:818: TEST_divergent_3: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T09:46:00.320 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:46:00.327 INFO:tasks.workunit.client.0.trial010.stdout:reading divergent objects 2026-02-13T09:46:00.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:821: TEST_divergent_3: echo 'reading divergent objects' 2026-02-13T09:46:00.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:822: TEST_divergent_3: ceph pg dump pgs 2026-02-13T09:46:00.546 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:46:00.546 INFO:tasks.workunit.client.0.trial010.stdout:1.1f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.256213+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.546 INFO:tasks.workunit.client.0.trial010.stdout:1.1e 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-13T09:45:49.140575+0000 28'100 61:177 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-13T09:45:49.140533+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:16:53.632647+0000 3 0 2026-02-13T09:46:00.546 INFO:tasks.workunit.client.0.trial010.stdout:1.1d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257300+0000 28'100 66:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.546 INFO:tasks.workunit.client.0.trial010.stdout:1.b 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:54.363480+0000 28'100 63:182 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-13T09:45:54.363439+0000 0'0 2026-02-13T09:44:00.268472+0000 0 1 periodic scrub scheduled @ 2026-02-14T12:07:01.536084+0000 3 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256738+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.9 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257807+0000 28'100 66:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.8 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:49.258598+0000 28'100 63:185 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-13T09:45:49.258559+0000 0'0 2026-02-13T09:44:00.268472+0000 0 1 periodic scrub scheduled @ 2026-02-14T12:18:22.530199+0000 3 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.7 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.255933+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.6 4 0 0 0 0 2112 0 0 17 84 17 active+clean 2026-02-13T09:45:48.257133+0000 51'101 61:161 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.5 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257823+0000 28'100 66:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.4 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:40.630734+0000 28'100 63:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.3 4 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:50.255898+0000 28'100 63:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.2 4 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256984+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.c 3 0 0 0 0 1600 0 0 14 86 14 active+clean 2026-02-13T09:45:40.631715+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.1 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-13T09:45:55.773086+0000 28'100 66:165 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-13T09:45:55.773042+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T11:31:21.689387+0000 2 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.1c 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:40.630202+0000 28'100 63:176 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.0 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:46.267223+0000 28'100 63:184 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-13T09:45:46.267183+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T18:52:03.974021+0000 3 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.d 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257911+0000 28'100 66:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.547 INFO:tasks.workunit.client.0.trial010.stdout:1.e 3 0 0 0 0 2088 0 0 17 84 17 active+clean 2026-02-13T09:45:48.256894+0000 44'101 61:170 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.f 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.255766+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.10 3 0 0 0 0 1536 0 0 10 90 10 active+clean 2026-02-13T09:45:45.306064+0000 28'100 63:185 [1,0,2] 1 [1,0,2] 1 28'100 2026-02-13T09:45:45.306013+0000 0'0 2026-02-13T09:44:00.268472+0000 0 1 periodic scrub scheduled @ 2026-02-14T18:16:03.587569+0000 3 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.11 3 0 0 0 0 1536 0 0 16 84 16 active+clean 2026-02-13T09:45:56.757083+0000 28'100 66:165 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-13T09:45:56.757035+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T15:56:25.331789+0000 3 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.12 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256990+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.13 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:50.256594+0000 28'100 63:174 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.14 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:40.631541+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.15 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:46.257152+0000 28'100 66:157 [2,0,1] 2 [2,0,1] 2 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.16 4 0 0 0 0 2048 0 0 16 84 16 active+clean 2026-02-13T09:45:50.100287+0000 28'100 61:177 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-13T09:45:50.100234+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T10:46:34.170613+0000 4 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.17 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:50.256151+0000 28'100 63:172 [1,2,0] 1 [1,2,0] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.18 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:40.628314+0000 28'100 63:177 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:44:00.268472+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.19 2 0 0 0 0 1024 0 0 16 84 16 active+clean 2026-02-13T09:45:49.790286+0000 28'100 66:165 [2,0,1] 2 [2,0,1] 2 28'100 2026-02-13T09:45:49.790228+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 periodic scrub scheduled @ 2026-02-14T21:38:30.913148+0000 2 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.1a 3 0 0 0 0 1600 0 0 16 84 16 active+clean 2026-02-13T09:45:48.256746+0000 28'100 65:178 [0,1,2] 0 [0,1,2] 0 28'100 2026-02-13T09:45:41.310022+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:1.1b 3 0 0 0 0 1600 0 0 10 90 10 active+clean 2026-02-13T09:45:50.256357+0000 28'100 63:175 [1,2,0] 1 [1,2,0] 1 28'100 2026-02-13T09:45:47.799601+0000 0'0 2026-02-13T09:44:00.268472+0000 0 0 queued for scrub 0 0 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:46:00.548 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:46:00.549 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:00.556 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: expr 2 + 2 2026-02-13T09:46:00.557 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: seq 1 4 2026-02-13T09:46:00.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:46:00.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T09:46:00.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:46:00.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T09:46:00.606 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:46:00.606 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T09:46:00.634 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:823: TEST_divergent_3: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:46:00.635 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:825: TEST_divergent_3: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T09:46:00.661 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: seq 1 2 2026-02-13T09:46:00.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:46:00.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_1 td/divergent-priors/existing 2026-02-13T09:46:00.680 INFO:tasks.workunit.client.0.trial010.stderr:error getting test/newobject_1: (2) No such file or directory 2026-02-13T09:46:00.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:827: TEST_divergent_3: for i in $(seq 1 $DIVERGENT_CREATE) 2026-02-13T09:46:00.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:829: TEST_divergent_3: rados -p test get newobject_2 td/divergent-priors/existing 2026-02-13T09:46:00.708 INFO:tasks.workunit.client.0.trial010.stderr:error getting test/newobject_2: (2) No such file or directory 2026-02-13T09:46:00.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:831: TEST_divergent_3: rm -f td/divergent-priors/existing 2026-02-13T09:46:00.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-13T09:46:00.714 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:833: TEST_divergent_3: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 20 _merge_object_divergent_entries: merging hoid 1:97db2a0f:::existing_2:head entries: 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-13T09:44:14.818449+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 20 _merge_object_divergent_entries: keeping 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-13T09:44:14.818449+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version: 28'2 first_divergent_update: 28'103 last_divergent_update: 28'103 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head has no more recent entries in log 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head olog_can_rollback_to: 28'106 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot rollback 28'103 (28'2) modify 1:97db2a0f:::existing_2:head by client.4541.0:1 2026-02-13T09:44:14.818449+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head cannot roll back, removing and adding to missing 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:97db2a0f:::existing_2:head prior_version 28'2 <= info.log_tail 28'89 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 20 _merge_object_divergent_entries: merging hoid 1:d858c035:::existing_1:head entries: 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-13T09:44:14.818467+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 20 _merge_object_divergent_entries: keeping 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-13T09:44:14.818467+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version: 28'1 first_divergent_update: 28'104 last_divergent_update: 28'104 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 20 _merge_object_divergent_entries: merging hoid 1:8881e6d8:::existing_3:head entries: 28'106 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T09:44:14.824646+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 20 _merge_object_divergent_entries: keeping 28'106 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T09:44:14.824646+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head has no more recent entries in log 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head olog_can_rollback_to: 28'106 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot rollback 28'104 (28'1) modify 1:d858c035:::existing_1:head by client.4540.0:1 2026-02-13T09:44:14.818467+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid object_not_in_store: 1 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version: 28'3 first_divergent_update: 28'106 last_divergent_update: 28'106 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head has no more recent entries in log 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:46:00.717 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head olog_can_rollback_to: 28'106 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot rollback 28'106 (28'3) delete 1:8881e6d8:::existing_3:head by client.4546.0:1 2026-02-13T09:44:14.824646+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head cannot roll back, removing and adding to missing 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head cannot roll back, removing and adding to missing 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219c58b640 10 _merge_object_divergent_entries: hoid 1:8881e6d8:::existing_3:head prior_version 28'3 <= info.log_tail 28'84 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:d858c035:::existing_1:head prior_version 28'1 <= info.log_tail 28'90 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 20 _merge_object_divergent_entries: merging hoid 1:da59f6e7:::newobject_1:head entries: 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4539.0:1 2026-02-13T09:44:14.818117+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 20 _merge_object_divergent_entries: keeping 28'102 (0'0) modify 1:da59f6e7:::newobject_1:head by client.4539.0:1 2026-02-13T09:44:14.818117+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:46:00.718 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version: 0'0 first_divergent_update: 28'102 last_divergent_update: 28'102 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head has no more recent entries in log 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219b589640 10 _merge_object_divergent_entries: hoid 1:da59f6e7:::newobject_1:head prior_version or op type indicates creation, deleting 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 20 _merge_object_divergent_entries: merging hoid 1:70b3bf12:::existing_4:head entries: 28'105 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-13T09:44:14.824681+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 20 _merge_object_divergent_entries: keeping 28'105 (28'4) delete 1:70b3bf12:::existing_4:head by client.4547.0:1 2026-02-13T09:44:14.824681+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: false, new_object: false 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 10 _merge_object_divergent_entries: hoid 1:70b3bf12:::existing_4:head prior_version: 28'4 first_divergent_update: 28'105 last_divergent_update: 28'105 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 10 _merge_object_divergent_entries: more recent entry found: 44'101 (28'4) modify 1:70b3bf12:::existing_4:head by client.4656.0:1 2026-02-13T09:45:00.480194+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false, already merged 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 20 _merge_object_divergent_entries: merging hoid 1:75ac5091:::newobject_2:head entries: 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-13T09:44:14.817645+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 20 _merge_object_divergent_entries: keeping 28'101 (0'0) modify 1:75ac5091:::newobject_2:head by client.4536.0:1 2026-02-13T09:44:14.817645+0000 0 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version: 0'0 first_divergent_update: 28'101 last_divergent_update: 28'101 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head has no more recent entries in log 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:45:38.003+0000 7f219dd8e640 10 _merge_object_divergent_entries: hoid 1:75ac5091:::newobject_2:head prior_version or op type indicates creation, deleting 2026-02-13T09:46:00.725 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-13T09:46:00.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:835: TEST_divergent_3: grep -q '_merge_object_divergent_entries: more recent entry found:' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:46:00.730 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: find td/divergent-priors -name '*osd*log' 2026-02-13T09:46:00.730 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:841: TEST_divergent_3: grep -q '_merge_object_divergent_entries.*prior_version or op type indicates creation' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:46:00.734 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:846: TEST_divergent_3: echo success 2026-02-13T09:46:00.735 INFO:tasks.workunit.client.0.trial010.stdout:success 2026-02-13T09:46:00.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:848: TEST_divergent_3: rm td/divergent-priors/td/divergent-priors/exp.16079.out 2026-02-13T09:46:00.735 INFO:tasks.workunit.client.0.trial010.stderr:rm: cannot remove 'td/divergent-priors/td/divergent-priors/exp.16079.out': No such file or directory 2026-02-13T09:46:00.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:849: TEST_divergent_3: delete_pool test 2026-02-13T09:46:00.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T09:46:00.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T09:46:00.986 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' does not exist 2026-02-13T09:46:00.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:850: TEST_divergent_3: kill_daemons td/divergent-priors 2026-02-13T09:46:00.997 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:46:00.997 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:46:00.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:46:00.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:46:00.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:46:06.313 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:46:06.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T09:46:06.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:46:06.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:46:06.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:46:06.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:46:06.315 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:46:06.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:46:06.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:46:06.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:46:06.321 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:46:06.322 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:46:06.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:46:06.323 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:46:06.324 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:46:06.324 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:46:06.325 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:46:06.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:46:06.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:46:06.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:46:06.327 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:46:06.327 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:46:06.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:46:06.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:46:06.355 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:46:06.356 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.356 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:46:06.359 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:46:06.359 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:46:06.360 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:44: run: for func in $funcs 2026-02-13T09:46:06.360 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:45: run: setup td/divergent-priors 2026-02-13T09:46:06.360 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/divergent-priors 2026-02-13T09:46:06.360 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/divergent-priors 2026-02-13T09:46:06.360 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:46:06.361 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:46:06.361 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:46:06.361 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:46:06.361 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:46:06.361 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:46:06.361 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:46:06.362 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:46:06.364 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:46:06.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:46:06.366 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:46:06.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:46:06.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:46:06.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:46:06.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:46:06.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.368 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:46:06.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:46:06.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:46:06.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/divergent-priors 2026-02-13T09:46:06.371 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:46:06.371 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.371 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.371 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.16079 2026-02-13T09:46:06.373 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:46:06.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T09:46:06.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:46:06.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/divergent-priors 1' TERM HUP INT 2026-02-13T09:46:06.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:46: run: TEST_divergent_ec td/divergent-priors 2026-02-13T09:46:06.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:227: TEST_divergent_ec: local dir=td/divergent-priors 2026-02-13T09:46:06.374 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: file_with_random_data 2026-02-13T09:46:06.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=512 2026-02-13T09:46:06.375 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-13T09:46:06.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:06.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.GbJpAMIyXg bs=512 count=1 2026-02-13T09:46:06.376 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:46:06.377 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:46:06.377 INFO:tasks.workunit.client.0.trial010.stderr:512 bytes copied, 0.000160247 s, 3.2 MB/s 2026-02-13T09:46:06.377 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:06.377 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:229: TEST_divergent_ec: local dummyfile=/tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:06.377 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: file_with_random_data 1000 2026-02-13T09:46:06.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2344: file_with_random_data: local size_bytes=1000 2026-02-13T09:46:06.378 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: mktemp 2026-02-13T09:46:06.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2345: file_with_random_data: local file=/tmp/tmp.x6tTWugsGd 2026-02-13T09:46:06.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2346: file_with_random_data: dd if=/dev/urandom of=/tmp/tmp.x6tTWugsGd bs=1000 count=1 2026-02-13T09:46:06.380 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records in 2026-02-13T09:46:06.380 INFO:tasks.workunit.client.0.trial010.stderr:1+0 records out 2026-02-13T09:46:06.380 INFO:tasks.workunit.client.0.trial010.stderr:1000 bytes (1.0 kB) copied, 0.000100035 s, 10.0 MB/s 2026-02-13T09:46:06.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2347: file_with_random_data: printf %s /tmp/tmp.x6tTWugsGd 2026-02-13T09:46:06.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:231: TEST_divergent_ec: local dummyfile2=/tmp/tmp.x6tTWugsGd 2026-02-13T09:46:06.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:233: TEST_divergent_ec: local num_osds=3 2026-02-13T09:46:06.381 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: expr 3 - 1 2026-02-13T09:46:06.382 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: seq 0 2 2026-02-13T09:46:06.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:234: TEST_divergent_ec: local 'osds=0 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:235: TEST_divergent_ec: run_mon td/divergent-priors a 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/divergent-priors 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/divergent-priors/a 2026-02-13T09:46:06.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/divergent-priors/a --run-dir=td/divergent-priors 2026-02-13T09:46:06.408 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:46:06.408 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:46:06.408 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:46:06.408 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:46:06.408 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.408 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.409 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:06.409 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/divergent-priors/a '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --mon-cluster-log-file=td/divergent-priors/log --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:46:06.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:46:06.441 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:46:06.441 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:46:06.441 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:46:06.441 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:46:06.442 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:46:06.442 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:46:06.442 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:46:06.442 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:46:06.443 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:46:06.443 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.443 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.443 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:46:06.443 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:46:06.443 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get fsid 2026-02-13T09:46:06.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:46:06.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:46:06.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:46:06.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:46:06.500 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-mon.a.asok 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:46:06.501 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.16079/ceph-mon.a.asok config get mon_host 2026-02-13T09:46:06.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:236: TEST_divergent_ec: run_mgr td/divergent-priors x 2026-02-13T09:46:06.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/divergent-priors 2026-02-13T09:46:06.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:46:06.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:46:06.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:46:06.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/divergent-priors/x 2026-02-13T09:46:06.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:46:06.671 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:46:06.671 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:46:06.671 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:46:06.671 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:46:06.671 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.671 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.671 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:06.672 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:46:06.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/divergent-priors/x '--log-file=td/divergent-priors/$name.log' '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --run-dir=td/divergent-priors '--pid-file=td/divergent-priors/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 0 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:46:06.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:46:06.697 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:46:06.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:46:06.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:46:06.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:46:06.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:46:06.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:46:06.699 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:46:06.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d 2026-02-13T09:46:06.700 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d 2026-02-13T09:46:06.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d' 2026-02-13T09:46:06.700 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:46:06.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDe8o5pnqc9KhAAFLsVBOafkNFDvIWcuRdiKg== 2026-02-13T09:46:06.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDe8o5pnqc9KhAAFLsVBOafkNFDvIWcuRdiKg=="}' 2026-02-13T09:46:06.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d -i td/divergent-priors/0/new.json 2026-02-13T09:46:06.825 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:46:06.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/0/new.json 2026-02-13T09:46:06.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDe8o5pnqc9KhAAFLsVBOafkNFDvIWcuRdiKg== --osd-uuid a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d 2026-02-13T09:46:06.852 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:06.846+0000 7f9b75fa8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:06.853 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:06.846+0000 7f9b75fa8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:06.855 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:06.846+0000 7f9b75fa8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:06.855 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:06.850+0000 7f9b75fa8a40 -1 bdev(0x55ce9f260c00 td/divergent-priors/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:46:06.855 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:06.850+0000 7f9b75fa8a40 -1 bluestore(td/divergent-priors/0) _read_fsid unparsable uuid 2026-02-13T09:46:07.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/0/keyring 2026-02-13T09:46:07.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:46:07.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:46:07.624 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:46:07.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:46:07.750 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:46:07.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:46:07.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:46:07.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:46:07.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:46:07.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:46:07.783 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:07.774+0000 7f2b2a64ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:07.785 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:07.778+0000 7f2b2a64ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:07.786 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:07.778+0000 7f2b2a64ea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:07.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:46:07.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:46:07.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:46:07.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:46:07.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:46:07.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:07.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:46:07.866 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:46:07.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:07.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:46:07.976 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:46:08.356 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:08.350+0000 7f2b2a64ea40 -1 Falling back to public interface 2026-02-13T09:46:08.978 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:46:08.978 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:08.978 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:46:08.978 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:46:08.979 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:08.979 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:46:09.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:46:09.314 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:09.306+0000 7f2b2a64ea40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:46:10.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:46:10.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:10.196 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:46:10.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:46:10.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:10.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:46:10.409 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3802582800,v1:127.0.0.1:6801/3802582800] [v2:127.0.0.1:6802/3802582800,v1:127.0.0.1:6803/3802582800] exists,up a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d 2026-02-13T09:46:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:46:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:46:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:46:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 1 2026-02-13T09:46:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:46:10.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:46:10.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:46:10.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:46:10.416 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:46:10.417 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:46:10.417 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=f9e827ba-9d6b-472f-8dcb-7869378e766b 2026-02-13T09:46:10.417 INFO:tasks.workunit.client.0.trial010.stdout:add osd1 f9e827ba-9d6b-472f-8dcb-7869378e766b 2026-02-13T09:46:10.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 f9e827ba-9d6b-472f-8dcb-7869378e766b' 2026-02-13T09:46:10.418 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:46:10.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDi8o5phJhlGRAAqts7+gS02zeVGSlmX+F9ig== 2026-02-13T09:46:10.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDi8o5phJhlGRAAqts7+gS02zeVGSlmX+F9ig=="}' 2026-02-13T09:46:10.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new f9e827ba-9d6b-472f-8dcb-7869378e766b -i td/divergent-priors/1/new.json 2026-02-13T09:46:10.652 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:46:10.661 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/1/new.json 2026-02-13T09:46:10.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDi8o5phJhlGRAAqts7+gS02zeVGSlmX+F9ig== --osd-uuid f9e827ba-9d6b-472f-8dcb-7869378e766b 2026-02-13T09:46:10.683 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:10.674+0000 7f468921ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:10.684 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:10.678+0000 7f468921ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:10.685 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:10.678+0000 7f468921ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:10.686 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:10.678+0000 7f468921ca40 -1 bdev(0x55c7041b2c00 td/divergent-priors/1/block) open stat got: (1) Operation not permitted 2026-02-13T09:46:10.686 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:10.678+0000 7f468921ca40 -1 bluestore(td/divergent-priors/1) _read_fsid unparsable uuid 2026-02-13T09:46:11.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/1/keyring 2026-02-13T09:46:11.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:46:11.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T09:46:11.334 INFO:tasks.workunit.client.0.trial010.stdout:adding osd1 key to auth repository 2026-02-13T09:46:11.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:46:11.637 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:46:11.638 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T09:46:11.638 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:46:11.638 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:46:11.639 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:46:11.639 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:46:11.667 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:11.662+0000 7fe6e6abaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:11.669 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:11.662+0000 7fe6e6abaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:11.670 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:11.662+0000 7fe6e6abaa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:11.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T09:46:11.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:46:11.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:46:11.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:46:11.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:46:11.850 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:11.851 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:46:11.851 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:46:11.851 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:11.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:46:12.028 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:12.022+0000 7fe6e6abaa40 -1 Falling back to public interface 2026-02-13T09:46:12.066 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:46:12.709 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:12.702+0000 7fe6e6abaa40 -1 osd.1 0 log_to_monitors true 2026-02-13T09:46:13.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:46:13.068 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:13.068 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:46:13.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:46:13.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:13.069 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:46:13.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:46:14.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:46:14.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:14.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:46:14.288 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:46:14.289 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:14.289 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:46:14.511 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/3119946980,v1:127.0.0.1:6811/3119946980] [v2:127.0.0.1:6812/3119946980,v1:127.0.0.1:6813/3119946980] exists,up f9e827ba-9d6b-472f-8dcb-7869378e766b 2026-02-13T09:46:14.514 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:46:14.514 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:46:14.514 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:46:14.514 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:237: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:239: TEST_divergent_ec: run_osd td/divergent-priors 2 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/divergent-priors 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:46:14.515 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:14.516 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:46:14.517 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:46:14.518 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=c2b38857-0f58-41fb-bc69-79b08112b08b 2026-02-13T09:46:14.518 INFO:tasks.workunit.client.0.trial010.stdout:add osd2 c2b38857-0f58-41fb-bc69-79b08112b08b 2026-02-13T09:46:14.519 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 c2b38857-0f58-41fb-bc69-79b08112b08b' 2026-02-13T09:46:14.519 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:46:14.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQDm8o5paSl3HxAAMCUcM2QACdWIPV6wtiKr+A== 2026-02-13T09:46:14.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQDm8o5paSl3HxAAMCUcM2QACdWIPV6wtiKr+A=="}' 2026-02-13T09:46:14.530 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new c2b38857-0f58-41fb-bc69-79b08112b08b -i td/divergent-priors/2/new.json 2026-02-13T09:46:14.757 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:46:14.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/divergent-priors/2/new.json 2026-02-13T09:46:14.767 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQDm8o5paSl3HxAAMCUcM2QACdWIPV6wtiKr+A== --osd-uuid c2b38857-0f58-41fb-bc69-79b08112b08b 2026-02-13T09:46:14.787 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:14.782+0000 7fa5497fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:14.788 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:14.782+0000 7fa5497fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:14.790 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:14.782+0000 7fa5497fba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:14.790 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:14.782+0000 7fa5497fba40 -1 bdev(0x559fd2278c00 td/divergent-priors/2/block) open stat got: (1) Operation not permitted 2026-02-13T09:46:14.790 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:14.782+0000 7fa5497fba40 -1 bluestore(td/divergent-priors/2) _read_fsid unparsable uuid 2026-02-13T09:46:15.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/divergent-priors/2/keyring 2026-02-13T09:46:15.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:46:15.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T09:46:15.447 INFO:tasks.workunit.client.0.trial010.stdout:adding osd2 key to auth repository 2026-02-13T09:46:15.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/divergent-priors/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:46:15.730 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:46:15.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T09:46:15.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:46:15.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:46:15.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:46:15.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:46:15.748 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:15.742+0000 7f9149fefa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:15.750 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:15.742+0000 7f9149fefa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:15.751 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:15.746+0000 7f9149fefa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:15.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T09:46:15.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:46:15.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:46:15.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:46:15.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:46:15.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:15.944 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:46:15.944 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:46:15.944 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:15.944 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:46:16.080 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:16.074+0000 7f9149fefa40 -1 Falling back to public interface 2026-02-13T09:46:16.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:46:16.691 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:16.682+0000 7f9149fefa40 -1 osd.2 0 log_to_monitors true 2026-02-13T09:46:17.158 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:46:17.158 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:17.158 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:46:17.158 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:46:17.159 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:17.159 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:46:17.367 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/2799431976,v1:127.0.0.1:6819/2799431976] [v2:127.0.0.1:6820/2799431976,v1:127.0.0.1:6821/2799431976] exists,up c2b38857-0f58-41fb-bc69-79b08112b08b 2026-02-13T09:46:17.368 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:46:17.368 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:46:17.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:46:17.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:242: TEST_divergent_ec: ceph osd set noout 2026-02-13T09:46:17.686 INFO:tasks.workunit.client.0.trial010.stderr:noout is set 2026-02-13T09:46:17.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:243: TEST_divergent_ec: ceph osd set noin 2026-02-13T09:46:17.991 INFO:tasks.workunit.client.0.trial010.stderr:noin is set 2026-02-13T09:46:18.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:244: TEST_divergent_ec: ceph osd set nodown 2026-02-13T09:46:18.294 INFO:tasks.workunit.client.0.trial010.stderr:nodown is set 2026-02-13T09:46:18.305 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:245: TEST_divergent_ec: create_ec_pool test true k=2 m=1 2026-02-13T09:46:18.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2522: create_ec_pool: local pool_name=test 2026-02-13T09:46:18.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2523: create_ec_pool: shift 2026-02-13T09:46:18.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2524: create_ec_pool: local allow_overwrites=true 2026-02-13T09:46:18.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2525: create_ec_pool: shift 2026-02-13T09:46:18.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2527: create_ec_pool: ceph osd erasure-code-profile set myprofile crush-failure-domain=osd k=2 m=1 2026-02-13T09:46:18.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2529: create_ec_pool: create_pool test 1 1 erasure myprofile 2026-02-13T09:46:18.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create test 1 1 erasure myprofile 2026-02-13T09:46:18.933 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' already exists 2026-02-13T09:46:18.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:46:19.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2531: create_ec_pool: '[' true = true ']' 2026-02-13T09:46:19.945 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2532: create_ec_pool: ceph osd pool set test allow_ec_overwrites true 2026-02-13T09:46:20.260 INFO:tasks.workunit.client.0.trial010.stderr:set pool 1 allow_ec_overwrites to true 2026-02-13T09:46:20.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2535: create_ec_pool: wait_for_clean 2026-02-13T09:46:20.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:46:20.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:46:20.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:46:20.270 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:46:20.271 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:46:20.271 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:46:20.271 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:46:20.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:46:20.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:46:20.387 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:46:20.388 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:46:20.388 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:46:20.388 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:46:20.388 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:46:20.388 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:46:20.604 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:46:20.605 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:46:20.605 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:46:20.605 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:46:20.605 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:20.605 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:46:20.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836485 2026-02-13T09:46:20.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836485 2026-02-13T09:46:20.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485' 2026-02-13T09:46:20.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:20.690 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:46:20.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705668 2026-02-13T09:46:20.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705668 2026-02-13T09:46:20.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668' 2026-02-13T09:46:20.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:20.774 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:46:20.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-13T09:46:20.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-13T09:46:20.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836485 1-38654705668 2-55834574851' 2026-02-13T09:46:20.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:20.858 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836485 2026-02-13T09:46:20.858 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:20.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:46:20.859 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836485 2026-02-13T09:46:20.860 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:20.861 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836485 2026-02-13T09:46:20.861 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836485 2026-02-13T09:46:20.862 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836485' 2026-02-13T09:46:20.862 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:21.089 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836485 -lt 21474836485 2026-02-13T09:46:21.089 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:21.089 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705668 2026-02-13T09:46:21.089 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:21.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:46:21.091 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705668 2026-02-13T09:46:21.092 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:21.093 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705668 2026-02-13T09:46:21.093 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705668 2026-02-13T09:46:21.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705668' 2026-02-13T09:46:21.094 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:46:21.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705668 -lt 38654705668 2026-02-13T09:46:21.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:21.317 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574851 2026-02-13T09:46:21.317 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:21.318 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:46:21.319 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574851 2026-02-13T09:46:21.319 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:21.320 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-13T09:46:21.320 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574851 2026-02-13T09:46:21.321 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574851' 2026-02-13T09:46:21.321 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:46:21.543 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-13T09:46:21.544 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:46:21.544 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:21.545 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:46:21.830 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:46:22.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:46:22.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:46:22.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:22.038 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:22.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:46:22.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:46:22.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:46:22.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2536: create_ec_pool: return 0 2026-02-13T09:46:22.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:247: TEST_divergent_ec: flush_pg_stats 2026-02-13T09:46:22.314 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:46:22.314 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:46:22.535 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:46:22.535 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:46:22.535 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:46:22.535 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:46:22.535 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:22.536 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:46:22.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836487 2026-02-13T09:46:22.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836487 2026-02-13T09:46:22.618 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487' 2026-02-13T09:46:22.618 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:22.618 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:46:22.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705670 2026-02-13T09:46:22.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705670 2026-02-13T09:46:22.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670' 2026-02-13T09:46:22.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:22.700 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:46:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574853 2026-02-13T09:46:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574853 2026-02-13T09:46:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836487 1-38654705670 2-55834574853' 2026-02-13T09:46:22.781 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:22.781 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836487 2026-02-13T09:46:22.782 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:22.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:46:22.783 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836487 2026-02-13T09:46:22.783 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:22.785 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836487 2026-02-13T09:46:22.785 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836487 2026-02-13T09:46:22.785 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836487' 2026-02-13T09:46:22.786 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:23.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836487 2026-02-13T09:46:23.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:23.002 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705670 2026-02-13T09:46:23.002 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:23.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:46:23.004 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705670 2026-02-13T09:46:23.004 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:23.005 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705670 2026-02-13T09:46:23.005 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705670 2026-02-13T09:46:23.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705670' 2026-02-13T09:46:23.006 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:46:23.229 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705670 -lt 38654705670 2026-02-13T09:46:23.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:23.230 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574853 2026-02-13T09:46:23.230 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:23.231 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:46:23.232 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574853 2026-02-13T09:46:23.233 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:23.234 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574853 2026-02-13T09:46:23.234 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574853' 2026-02-13T09:46:23.234 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574853 2026-02-13T09:46:23.235 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:46:23.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574854 -lt 55834574853 2026-02-13T09:46:23.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:248: TEST_divergent_ec: wait_for_clean 2026-02-13T09:46:23.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:46:23.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:46:23.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:46:23.454 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:46:23.455 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:46:23.455 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:46:23.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:46:23.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:46:23.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:46:23.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:46:23.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:46:23.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:46:23.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:46:23.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:46:23.556 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:46:23.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:46:23.773 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:46:23.773 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:46:23.773 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:46:23.773 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:23.773 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:46:23.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836489 2026-02-13T09:46:23.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836489 2026-02-13T09:46:23.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836489' 2026-02-13T09:46:23.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:23.857 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:46:23.939 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705673 2026-02-13T09:46:23.939 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705673 2026-02-13T09:46:23.939 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836489 1-38654705673' 2026-02-13T09:46:23.939 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:23.939 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:46:24.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574856 2026-02-13T09:46:24.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574856 2026-02-13T09:46:24.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836489 1-38654705673 2-55834574856' 2026-02-13T09:46:24.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:24.019 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836489 2026-02-13T09:46:24.019 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:24.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:46:24.021 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836489 2026-02-13T09:46:24.021 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:24.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836489 2026-02-13T09:46:24.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836489' 2026-02-13T09:46:24.023 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836489 2026-02-13T09:46:24.023 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:24.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836487 -lt 21474836489 2026-02-13T09:46:24.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:46:25.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:46:25.256 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:25.470 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836489 -lt 21474836489 2026-02-13T09:46:25.471 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:25.471 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705673 2026-02-13T09:46:25.472 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:25.472 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:46:25.473 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705673 2026-02-13T09:46:25.474 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:25.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705673 2026-02-13T09:46:25.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705673' 2026-02-13T09:46:25.476 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705673 2026-02-13T09:46:25.476 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:46:25.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705673 -lt 38654705673 2026-02-13T09:46:25.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:25.700 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574856 2026-02-13T09:46:25.700 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:25.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:46:25.702 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574856 2026-02-13T09:46:25.702 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:25.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574856 2026-02-13T09:46:25.704 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574856 2026-02-13T09:46:25.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574856' 2026-02-13T09:46:25.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:46:25.914 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574856 -lt 55834574856 2026-02-13T09:46:25.915 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:46:25.916 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:25.916 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:26.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:46:26.202 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:46:26.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:46:26.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:46:26.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:46:26.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:46:26.202 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:46:26.203 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:46:26.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:46:26.414 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:46:26.414 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:26.414 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:26.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:46:26.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:46:26.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:46:26.698 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: ceph pg dump pgs --format=json 2026-02-13T09:46:26.698 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: jq '.pg_stats[0].up_primary' 2026-02-13T09:46:26.896 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:26.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:251: TEST_divergent_ec: local divergent=1 2026-02-13T09:46:26.906 INFO:tasks.workunit.client.0.trial010.stdout:primary and soon to be divergent is 1 2026-02-13T09:46:26.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:252: TEST_divergent_ec: echo 'primary and soon to be divergent is 1' 2026-02-13T09:46:26.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:253: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:46:27.111 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:46:27.111 INFO:tasks.workunit.client.0.trial010.stdout:1.0 0 0 0 0 0 0 0 0 0 0 0 active+clean 2026-02-13T09:46:20.505373+0000 0'0 26:16 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T15:41:21.703793+0000 0 0 2026-02-13T09:46:27.111 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:46:27.111 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:46:27.111 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:254: TEST_divergent_ec: local non_divergent= 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 0 = 1 ']' 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0' 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 1 = 1 ']' 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:258: TEST_divergent_ec: continue 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:255: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:27.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:257: TEST_divergent_ec: '[' 2 = 1 ']' 2026-02-13T09:46:27.122 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:260: TEST_divergent_ec: non_divergent=' 0 2' 2026-02-13T09:46:27.122 INFO:tasks.workunit.client.0.trial010.stdout:writing initial objects 2026-02-13T09:46:27.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:263: TEST_divergent_ec: echo 'writing initial objects' 2026-02-13T09:46:27.123 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: seq 1 100 2026-02-13T09:46:27.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_1 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_2 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_3 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.200 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.200 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.228 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.229 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_5 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.256 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.256 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_6 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_7 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.313 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.313 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_8 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_9 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_10 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_11 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_12 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_13 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_14 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.506 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_15 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.533 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.533 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_16 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.562 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_17 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_18 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_19 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.638 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.638 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_20 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.667 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.667 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_21 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_22 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.724 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.724 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_23 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_24 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_25 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.800 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.800 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_26 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.826 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_27 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.855 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.856 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_28 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_29 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.912 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.912 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_30 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.940 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.940 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_31 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.969 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.969 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_32 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:27.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:27.997 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_33 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_34 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.042 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_35 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_36 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_37 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_38 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_39 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_40 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_41 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.232 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.232 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_42 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.257 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.257 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_43 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.284 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.284 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_44 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.313 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.313 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_45 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_46 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_47 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_48 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_49 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_50 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_51 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.509 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.509 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_52 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_53 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.565 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.565 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_54 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_55 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_56 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_57 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.677 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_58 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_59 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_60 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_61 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.789 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_62 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_63 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_64 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_65 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.901 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.901 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_66 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.929 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.929 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_67 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_68 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:28.973 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:28.973 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_69 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.000 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.000 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_70 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_71 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.054 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.054 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_72 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.082 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.082 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_73 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.108 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.109 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_74 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.136 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_75 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_76 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.192 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.192 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_77 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.220 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.220 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_78 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_79 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_80 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.303 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_81 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.330 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.330 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_82 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_83 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_84 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.406 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.406 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_85 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.436 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_86 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_87 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_88 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_89 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.541 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.542 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_90 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.566 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.566 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_91 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_92 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_93 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_94 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_95 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_96 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_97 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.761 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_98 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:265: TEST_divergent_ec: for i in $(seq 1 $testobjects) 2026-02-13T09:46:29.816 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:267: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:29.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:46:29.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:270: TEST_divergent_ec: wait_for_clean 2026-02-13T09:46:29.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:46:29.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:46:29.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:46:29.845 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:46:29.846 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:46:29.846 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:46:29.846 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:46:29.846 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:46:29.847 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:46:29.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:46:29.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:46:29.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:46:29.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:46:29.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:46:29.920 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:46:30.136 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:46:30.137 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:46:30.137 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:46:30.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:46:30.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:30.137 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:46:30.215 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=21474836492 2026-02-13T09:46:30.215 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 21474836492 2026-02-13T09:46:30.215 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492' 2026-02-13T09:46:30.215 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:30.215 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:46:30.295 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=38654705676 2026-02-13T09:46:30.295 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 38654705676 2026-02-13T09:46:30.295 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676' 2026-02-13T09:46:30.295 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:30.295 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:46:30.376 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574859 2026-02-13T09:46:30.376 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574859 2026-02-13T09:46:30.376 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-21474836492 1-38654705676 2-55834574859' 2026-02-13T09:46:30.376 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:30.377 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-21474836492 2026-02-13T09:46:30.377 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:30.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:46:30.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-21474836492 2026-02-13T09:46:30.379 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:30.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=21474836492 2026-02-13T09:46:30.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 21474836492' 2026-02-13T09:46:30.380 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 21474836492 2026-02-13T09:46:30.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:30.596 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836490 -lt 21474836492 2026-02-13T09:46:30.596 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:46:31.597 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:46:31.598 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:31.818 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836493 -lt 21474836492 2026-02-13T09:46:31.819 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:31.819 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-38654705676 2026-02-13T09:46:31.819 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:31.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:46:31.821 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-38654705676 2026-02-13T09:46:31.821 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:31.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=38654705676 2026-02-13T09:46:31.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 38654705676' 2026-02-13T09:46:31.823 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 38654705676 2026-02-13T09:46:31.824 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:46:32.039 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 38654705676 -lt 38654705676 2026-02-13T09:46:32.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:32.040 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-55834574859 2026-02-13T09:46:32.040 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:32.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:46:32.042 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-55834574859 2026-02-13T09:46:32.042 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:32.044 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574859 2026-02-13T09:46:32.044 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 55834574859' 2026-02-13T09:46:32.044 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 55834574859 2026-02-13T09:46:32.045 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:46:32.263 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574859 -lt 55834574859 2026-02-13T09:46:32.264 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:46:32.265 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:32.265 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:32.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:46:32.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:46:32.557 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:46:32.557 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:46:32.557 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:46:32.557 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:46:32.558 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:46:32.558 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:46:32.775 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:46:32.775 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:46:32.776 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:32.776 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:33.066 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:46:33.067 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:46:33.067 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:46:33.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: get_pg test existing_1 2026-02-13T09:46:33.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1084: get_pg: local poolname=test 2026-02-13T09:46:33.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1085: get_pg: local objectname=existing_1 2026-02-13T09:46:33.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: ceph --format json osd map test existing_1 2026-02-13T09:46:33.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1087: get_pg: jq -r .pgid 2026-02-13T09:46:33.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:272: TEST_divergent_ec: local pgid=1.0 2026-02-13T09:46:33.289 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:275: TEST_divergent_ec: echo 'blackholing osds 0 2' 2026-02-13T09:46:33.289 INFO:tasks.workunit.client.0.trial010.stdout:blackholing osds 0 2 2026-02-13T09:46:33.289 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:276: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:46:33.490 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:46:33.490 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 0 0 0 51200 0 0 16 84 16 active+clean 2026-02-13T09:46:20.505373+0000 26'100 26:116 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T15:41:21.703793+0000 0 0 2026-02-13T09:46:33.490 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:46:33.490 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:46:33.491 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:33.499 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:33.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.0 2026-02-13T09:46:33.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:46:33.499 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:46:33.500 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:46:33.501 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:33.501 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:33.501 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:46:33.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T09:46:33.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok config set objectstore_blackhole 1 2026-02-13T09:46:33.554 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:46:33.554 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:46:33.554 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:46:33.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:277: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:33.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: get_asok_path osd.2 2026-02-13T09:46:33.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:46:33.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:46:33.561 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:46:33.561 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:33.561 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:33.561 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:46:33.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T09:46:33.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:279: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok config set objectstore_blackhole 1 2026-02-13T09:46:33.611 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:46:33.611 INFO:tasks.workunit.client.0.trial010.stdout: "success": "objectstore_blackhole = '' (not observed, change may require restart) " 2026-02-13T09:46:33.611 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:46:33.617 INFO:tasks.workunit.client.0.trial010.stdout:writing divergent object 2026-02-13T09:46:33.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:283: TEST_divergent_ec: echo 'writing divergent object' 2026-02-13T09:46:33.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:285: TEST_divergent_ec: sleep 1 2026-02-13T09:46:33.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:284: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.x6tTWugsGd 2026-02-13T09:46:34.618 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:287: TEST_divergent_ec: rados -p test mksnap snap1 2026-02-13T09:46:34.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:286: TEST_divergent_ec: rados -p test put existing_100 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:34.691 INFO:tasks.workunit.client.0.trial010.stdout:created pool test snap snap1 2026-02-13T09:46:34.693 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:289: TEST_divergent_ec: sleep 10 2026-02-13T09:46:34.694 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: expr 100 - 1 2026-02-13T09:46:34.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:288: TEST_divergent_ec: rados -p test put existing_99 /tmp/tmp.GbJpAMIyXg 2026-02-13T09:46:44.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:290: TEST_divergent_ec: killall -9 rados 2026-02-13T09:46:44.740 INFO:tasks.workunit.client.0.trial010.stderr:rados: no process found 2026-02-13T09:46:44.740 INFO:tasks.workunit.client.0.trial010.stdout:killing all the osds 2026-02-13T09:46:44.740 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:293: TEST_divergent_ec: echo 'killing all the osds' 2026-02-13T09:46:44.741 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:294: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:46:44.951 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:46:44.951 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 active+clean 2026-02-13T09:46:20.505373+0000 27'104 27:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T17:48:49.604016+0000 0 0 2026-02-13T09:46:44.951 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:46:44.951 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:46:44.951 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:44.960 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:295: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd 2026-02-13T09:46:44.960 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:46:44.961 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:46:44.961 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:46:44.961 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:46:44.961 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:46:45.070 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:46:45.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:45.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.0 2026-02-13T09:46:45.339 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:46:45.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:45.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.1 2026-02-13T09:46:45.627 INFO:tasks.workunit.client.0.trial010.stderr:osd.1 is already down. 2026-02-13T09:46:45.637 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:296: TEST_divergent_ec: for i in $osds 2026-02-13T09:46:45.637 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:298: TEST_divergent_ec: ceph osd down osd.2 2026-02-13T09:46:45.932 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already down. 2026-02-13T09:46:45.943 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:45.944 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.0 2026-02-13T09:46:46.221 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already out. 2026-02-13T09:46:46.231 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:300: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:46.231 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:302: TEST_divergent_ec: ceph osd out osd.2 2026-02-13T09:46:46.504 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already out. 2026-02-13T09:46:46.516 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:306: TEST_divergent_ec: echo 'bringing up non_divergent 0 2' 2026-02-13T09:46:46.516 INFO:tasks.workunit.client.0.trial010.stdout:bringing up non_divergent 0 2 2026-02-13T09:46:46.516 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:307: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:46:46.718 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:46:46.719 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 0 0 0 51712 0 0 14 90 14 stale+active+clean 2026-02-13T09:46:20.505373+0000 27'104 27:122 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T17:48:49.604016+0000 0 0 2026-02-13T09:46:46.719 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:46:46.719 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:46:46.719 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:46.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:46.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:46:46.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:46.733 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:46.734 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:46.734 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:46:46.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:46:46.736 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:46:46.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:46:46.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:46:46.737 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T09:46:46.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:46:46.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:46:46.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:46:46.737 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:46:46.755 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:46.745+0000 7f3b449e9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:46.756 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:46.749+0000 7f3b449e9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:46.757 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:46.749+0000 7f3b449e9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:46.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:46:46.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:46:46.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:46:46.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:46:46.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:46:46.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:46.949 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:46:46.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:46:46.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:46.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:46:47.137 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:47.129+0000 7f3b449e9a40 -1 Falling back to public interface 2026-02-13T09:46:47.171 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:46:47.837 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:47.833+0000 7f3b449e9a40 -1 osd.0 26 log_to_monitors true 2026-02-13T09:46:48.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:46:48.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:48.172 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:46:48.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:46:48.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:48.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:46:48.393 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up out weight 0 up_from 34 up_thru 0 down_at 28 last_clean_interval [5,26) [v2:127.0.0.1:6800/3945366505,v1:127.0.0.1:6801/3945366505] [v2:127.0.0.1:6802/3945366505,v1:127.0.0.1:6803/3945366505] exists,up a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d 2026-02-13T09:46:48.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:46:48.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:308: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:310: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:46:48.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:46:48.398 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:46:48.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:46:48.400 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:46:48.400 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:46:48.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:46:48.401 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T09:46:48.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:46:48.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:46:48.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:46:48.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:46:48.419 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:48.413+0000 7f56a0bc8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:48.420 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:48.417+0000 7f56a0bc8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:48.421 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:48.417+0000 7f56a0bc8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:46:48.613 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:46:48.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:46:48.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:46:48.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:46:48.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:46:48.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:48.614 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:46:48.615 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:46:48.615 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:48.615 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:46:48.821 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:48.817+0000 7f56a0bc8a40 -1 Falling back to public interface 2026-02-13T09:46:48.834 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:46:49.482 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:46:49.477+0000 7f56a0bc8a40 -1 osd.2 26 log_to_monitors true 2026-02-13T09:46:49.836 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:46:49.836 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:46:49.837 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:46:49.837 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:46:49.838 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:46:49.838 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:46:50.054 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up out weight 0 up_from 37 up_thru 0 down_at 30 last_clean_interval [13,26) [v2:127.0.0.1:6810/1174296324,v1:127.0.0.1:6811/1174296324] [v2:127.0.0.1:6812/1174296324,v1:127.0.0.1:6813/1174296324] exists,up c2b38857-0f58-41fb-bc69-79b08112b08b 2026-02-13T09:46:50.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:46:50.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:46:50.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:46:50.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:50.055 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.0 2026-02-13T09:46:50.302 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already in. 2026-02-13T09:46:50.312 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:312: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:46:50.312 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:314: TEST_divergent_ec: ceph osd in osd.2 2026-02-13T09:46:50.590 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already in. 2026-02-13T09:46:50.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:317: TEST_divergent_ec: sleep 5 2026-02-13T09:46:55.601 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: expr 2 + 2 2026-02-13T09:46:55.602 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:321: TEST_divergent_ec: objname=existing_4 2026-02-13T09:46:55.602 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:322: TEST_divergent_ec: echo 'writing non-divergent object existing_4' 2026-02-13T09:46:55.602 INFO:tasks.workunit.client.0.trial010.stdout:writing non-divergent object existing_4 2026-02-13T09:46:55.603 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:323: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:46:55.802 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:46:55.802 INFO:tasks.workunit.client.0.trial010.stdout:1.0 100 0 100 0 0 51200 0 0 16 84 16 active+undersized+degraded 2026-02-13T09:46:50.635051+0000 26'100 40:125 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T15:59:49.295955+0000 0 0 2026-02-13T09:46:55.802 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:46:55.803 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:46:55.803 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:46:55.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:324: TEST_divergent_ec: rados -p test put existing_4 /tmp/tmp.x6tTWugsGd 2026-02-13T09:46:55.841 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:325: TEST_divergent_ec: rm -f /tmp/tmp.x6tTWugsGd 2026-02-13T09:46:55.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:46:55.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:327: TEST_divergent_ec: wait_for_clean 2026-02-13T09:46:55.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:46:55.843 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:46:55.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:46:55.844 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:46:55.845 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:46:55.845 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:46:55.845 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:46:55.845 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:46:55.845 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:46:55.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:46:55.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:46:55.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:46:55.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:46:55.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:46:55.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:46:56.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:46:56.132 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:46:56.132 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:46:56.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:46:56.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:56.133 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:46:56.217 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888068 2026-02-13T09:46:56.217 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888068 2026-02-13T09:46:56.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-146028888068' 2026-02-13T09:46:56.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:56.218 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:46:56.278 INFO:tasks.workunit.client.0.trial010.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-13T09:46:56.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T09:46:56.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T09:46:56.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T09:46:56.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:46:56.282 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:46:56.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=158913789956 2026-02-13T09:46:56.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 158913789956 2026-02-13T09:46:56.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-146028888068 2-158913789956' 2026-02-13T09:46:56.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:56.367 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-146028888068 2026-02-13T09:46:56.367 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:56.368 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:46:56.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-146028888068 2026-02-13T09:46:56.368 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:56.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888068 2026-02-13T09:46:56.370 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 146028888068 2026-02-13T09:46:56.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 146028888068' 2026-02-13T09:46:56.371 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:56.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888066 -lt 146028888068 2026-02-13T09:46:56.595 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:46:57.596 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:46:57.596 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:46:57.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888068 -lt 146028888068 2026-02-13T09:46:57.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:46:57.817 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-158913789956 2026-02-13T09:46:57.818 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:46:57.819 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:46:57.819 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-158913789956 2026-02-13T09:46:57.820 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:46:57.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=158913789956 2026-02-13T09:46:57.821 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 158913789956 2026-02-13T09:46:57.822 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 158913789956' 2026-02-13T09:46:57.822 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:46:58.050 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 158913789956 -lt 158913789956 2026-02-13T09:46:58.050 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:46:58.051 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:58.051 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:58.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:46:58.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:46:58.345 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:46:58.345 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:46:58.345 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:46:58.345 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:46:58.345 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:46:58.346 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:46:58.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:46:58.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:46:58.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:58.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:58.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:46:58.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T09:46:58.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T09:46:58.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T09:46:58.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:46:58.853 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T09:46:58.952 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:46:58.953 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:46:58.954 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:46:58.954 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:46:58.954 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:46:58.954 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:46:58.954 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:46:58.954 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:46:59.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:46:59.166 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:46:59.166 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:46:59.166 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:46:59.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:46:59.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:46:59.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:46:59.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:46:59.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:46:59.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:46:59.447 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:46:59.447 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:46:59.447 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:46:59.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:46:59.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:46:59.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T09:46:59.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:46:59.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T09:46:59.930 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:46:59.930 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:46:59.931 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:46:59.931 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:46:59.931 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:46:59.931 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:46:59.931 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:46:59.931 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:00.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:00.142 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:00.143 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:00.143 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:00.424 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:00.425 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:00.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:00.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:00.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T09:47:00.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:00.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T09:47:01.102 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:01.102 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:01.103 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:01.103 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:01.103 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:01.103 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:01.104 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:01.104 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:01.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:01.317 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:01.318 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:01.318 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:01.608 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:01.609 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:01.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:01.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:01.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T09:47:01.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:01.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T09:47:02.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:02.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:02.707 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:02.707 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:02.707 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:02.707 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:02.707 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:02.707 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:02.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:02.920 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:02.921 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:02.921 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:03.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:03.209 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:03.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:03.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:03.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T09:47:03.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:03.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T09:47:05.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:05.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:05.095 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:05.095 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:05.095 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:05.095 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:05.095 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:05.095 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:05.301 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:05.302 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:05.302 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:05.303 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:05.577 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:05.578 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:05.869 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:05.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:05.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T09:47:05.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:05.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T09:47:09.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:09.071 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:09.072 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:09.072 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:09.072 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:09.072 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:09.072 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:09.072 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:09.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:09.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:09.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:09.286 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:09.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:09.576 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:09.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:09.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:09.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T09:47:09.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:09.870 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T09:47:16.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:16.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:16.271 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:16.271 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:16.271 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:16.271 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:16.271 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:16.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:16.490 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:16.490 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:16.490 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:16.490 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:16.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:16.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:16.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:16.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:16.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:16.784 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:16.784 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:16.784 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:16.784 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:17.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:17.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:17.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T09:47:17.074 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:17.074 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T09:47:24.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:24.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:24.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:24.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:24.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:24.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:24.376 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:24.376 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:24.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:24.593 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:24.593 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:24.593 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:24.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:25.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:25.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:25.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T09:47:25.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T09:47:25.457 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_fingerprint": "e3c445a1-133f-4e56-bdf5-f0d5898c3131", 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "version": "20.2.0-636-g3b40640f", 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "commit": "3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb", 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "timestamp": "2026-02-13T09:47:25.454064+0000", 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "tag": "", 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "health": { 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "status": "HEALTH_WARN", 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "checks": { 2026-02-13T09:47:25.458 INFO:tasks.workunit.client.0.trial010.stdout: "OSDMAP_FLAGS": { 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "count": 17 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [], 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "OSD_DOWN": { 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:47:25.459 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: "message": "1 osds down", 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: "message": "osd.1 (root=default,host=trial010) is down" 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: "PG_DEGRADED": { 2026-02-13T09:47:25.460 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:47:25.461 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "mutes": [] 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_first_committed": 1, 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_last_committed": 1, 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "monmap": { 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:46:06.398286Z", 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:46:06.398286Z", 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release": 20, 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release_name": "tentacle", 2026-02-13T09:47:25.462 INFO:tasks.workunit.client.0.trial010.stdout: "election_strategy": 1, 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "disallowed_leaders": "", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": false, 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "tiebreaker_mon": "", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "removed_ranks": "", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "features": { 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "persistent": [ 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "kraken", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "luminous", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "mimic", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap-prune", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "nautilus", 2026-02-13T09:47:25.463 INFO:tasks.workunit.client.0.trial010.stdout: "octopus", 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "pacific", 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "elector-pinging", 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "quincy", 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "reef", 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "squid", 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "tentacle", 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "nvmeof_beacon_diff" 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "optional": [] 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: "mons": [ 2026-02-13T09:47:25.464 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "rank": 0, 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "name": "a", 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115", 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 0 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T09:47:25.465 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "priority": 0, 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 0, 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "crush_location": "{}" 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "quorum": [ 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: 0 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap": { 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 40, 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:47:25.466 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:46:06.498241+0000", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:46:50.630950+0000", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "last_up_change": "2026-02-13T09:46:49.635419+0000", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "last_in_change": "2026-02-13T09:46:50.528568+0000", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "flags_num": 5800384, 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "flags_set": [ 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "nodown", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "noin", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "noout", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "pglog_hardlimit", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snapdirs", 2026-02-13T09:47:25.467 INFO:tasks.workunit.client.0.trial010.stdout: "recovery_deletes", 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "sortbitwise" 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "crush_version": 10, 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_snapshot": "", 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "pool_max": 1, 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "max_osd": 3, 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "require_min_compat_client": "luminous", 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "min_compat_client": "jewel", 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "require_osd_release": "tentacle", 2026-02-13T09:47:25.468 INFO:tasks.workunit.client.0.trial010.stdout: "allow_crimson": false, 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "pools": [ 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "pool_name": "test", 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "create_time": "2026-02-13T09:46:18.784061+0000", 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "flags": 16389, 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "type": 3, 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "size": 3, 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "min_size": 2, 2026-02-13T09:47:25.469 INFO:tasks.workunit.client.0.trial010.stdout: "crush_rule": 1, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_count": 0, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_target": 0, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "is_stretch_pool": false, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "object_hash": 2, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "pg_autoscale_mode": "off", 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num": 1, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num": 1, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num_target": 1, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_target": 1, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_pending": 1, 2026-02-13T09:47:25.470 INFO:tasks.workunit.client.0.trial010.stdout: "last_pg_merge_meta": { 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "source_pgid": "0.0", 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "ready_epoch": 0, 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_started": 0, 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": 0, 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "source_version": "0'0", 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "target_version": "0'0" 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "last_change": "27", 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend": "0", 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "auid": 0, 2026-02-13T09:47:25.471 INFO:tasks.workunit.client.0.trial010.stdout: "snap_mode": "pool", 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "snap_seq": 1, 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "snap_epoch": 27, 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "pool_snaps": [ 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "snapid": 1, 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "stamp": "2026-02-13T09:46:34.637627+0000", 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "name": "snap1" 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps": "[]", 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_bytes": 0, 2026-02-13T09:47:25.472 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_objects": 0, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "tiers": [], 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "tier_of": -1, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "read_tier": -1, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "write_tier": -1, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "cache_mode": "none", 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_bytes": 0, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_objects": 0, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_flush_age": 0, 2026-02-13T09:47:25.473 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_evict_age": 0, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profile": "myprofile", 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_params": { 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "type": "none" 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_period": 0, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_count": 0, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "use_gmt_hitset": true, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "min_read_recency_for_promote": 0, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "min_write_recency_for_promote": 0, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_search_last_n": 0, 2026-02-13T09:47:25.474 INFO:tasks.workunit.client.0.trial010.stdout: "grade_table": [], 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "stripe_width": 8192, 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "expected_num_objects": 0, 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "fast_read": false, 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "nonprimary_shards": "{}", 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "options": {}, 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "application_metadata": {} 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "osds": [ 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d", 2026-02-13T09:47:25.475 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 5, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 34, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 39, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 28, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.476 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6800", 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6801", 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.477 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6802", 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6803", 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:47:25.478 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6806", 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6807", 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.479 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6804", 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6805", 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3945366505 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.480 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6801/3945366505", 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6803/3945366505", 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3945366505", 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3945366505", 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "f9e827ba-9d6b-472f-8dcb-7869378e766b", 2026-02-13T09:47:25.481 INFO:tasks.workunit.client.0.trial010.stdout: "up": 0, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 0, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 0, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 9, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 22, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 29, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.482 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.483 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:47:25.484 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.485 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.486 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/3119946980", 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/3119946980", 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3119946980", 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3119946980", 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "exists" 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "c2b38857-0f58-41fb-bc69-79b08112b08b", 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:47:25.487 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 13, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 26, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 37, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 0, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 30, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:47:25.488 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.489 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.490 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.491 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 1174296324 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/1174296324", 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/1174296324", 2026-02-13T09:47:25.492 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/1174296324", 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/1174296324", 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "osd_xinfo": [ 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:46:45.279880+0000", 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:47:25.493 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:46:10.279009+0000", 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:46:45.567815+0000", 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:47:25.494 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:46:45.871741+0000", 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:46:17.661249+0000", 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap": [], 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_items": [], 2026-02-13T09:47:25.495 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_primaries": [], 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "pg_temp": [], 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "primary_temp": [], 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "blocklist": {}, 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "range_blocklist": {}, 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profiles": { 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "default": { 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "m": "2", 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "myprofile": { 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "crush-device-class": "", 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "crush-failure-domain": "osd", 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "crush-num-failure-domains": "0", 2026-02-13T09:47:25.496 INFO:tasks.workunit.client.0.trial010.stdout: "crush-osds-per-failure-domain": "0", 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "crush-root": "default", 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "m": "1", 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps_queue": [], 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "new_removed_snaps": [], 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "new_purged_snaps": [], 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "crush_node_flags": {}, 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "device_class_flags": {}, 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": { 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_enabled": false, 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_bucket_count": 0, 2026-02-13T09:47:25.497 INFO:tasks.workunit.client.0.trial010.stdout: "degraded_stretch_mode": 0, 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "recovering_stretch_mode": 0, 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_bucket": 0 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "osd_metadata": [ 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6802/3945366505,v1:127.0.0.1:6803/3945366505]", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:47:25.498 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:47:25.499 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:46:07.446198Z", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6800/3945366505,v1:127.0.0.1:6801/3945366505]", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3945366505,v1:127.0.0.1:6807/3945366505]", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3945366505,v1:127.0.0.1:6805/3945366505]", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:47:25.500 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/3119946980,v1:127.0.0.1:6813/3119946980]", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:47:25.501 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:47:25.502 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:46:11.236901Z", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/3119946980,v1:127.0.0.1:6811/3119946980]", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3119946980,v1:127.0.0.1:6817/3119946980]", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3119946980,v1:127.0.0.1:6815/3119946980]", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:47:25.503 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/1174296324,v1:127.0.0.1:6813/1174296324]", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:47:25.504 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:47:25.505 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:46:15.336849Z", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/1174296324,v1:127.0.0.1:6811/1174296324]", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/1174296324,v1:127.0.0.1:6817/1174296324]", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/1174296324,v1:127.0.0.1:6815/1174296324]", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:47:25.506 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_clean_epochs": { 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "min_last_epoch_clean": 0, 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": { 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "per_pool": [] 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "osd_epochs": [ 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:47:25.507 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 34 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 38 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_first_committed": 1, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_last_committed": 40, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "crushmap": { 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "devices": [ 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.0", 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.1", 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:47:25.508 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.2", 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "types": [ 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 0, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd" 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "name": "host" 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 2, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "name": "chassis" 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.509 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 3, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "name": "rack" 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 4, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "name": "row" 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 5, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pdu" 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 6, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pod" 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 7, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "name": "room" 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 8, 2026-02-13T09:47:25.510 INFO:tasks.workunit.client.0.trial010.stdout: "name": "datacenter" 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 9, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "name": "zone" 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 10, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "name": "region" 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "name": "root" 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "buckets": [ 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "id": -1, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default", 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:47:25.511 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "id": -2, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default~ssd", 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.512 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010", 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:47:25.513 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010~ssd", 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.514 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "rules": [ 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 0, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "replicated_rule", 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_firstn", 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.515 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 1, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "test", 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "type": 3, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "op": "set_chooseleaf_tries", 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "num": 5 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "op": "set_choose_tries", 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "num": 100 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_indep", 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:47:25.516 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stderr:report 3539028363 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: "tunables": { 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_tries": 0, 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_fallback_tries": 0, 2026-02-13T09:47:25.517 INFO:tasks.workunit.client.0.trial010.stdout: "choose_total_tries": 50, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_descend_once": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_vary_r": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_stable": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "msr_descents": 100, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "msr_collision_tries": 100, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "straw_calc_version": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "allowed_bucket_algs": 54, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "profile": "jewel", 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_tunables": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "legacy_tunables": 0, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "minimum_required_version": "jewel", 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables2": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "has_v2_rules": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables3": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "has_v3_rules": 0, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "has_v4_buckets": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables5": 1, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "has_v5_rules": 0, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "has_msr_rules": 0 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "choose_args": {} 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.518 INFO:tasks.workunit.client.0.trial010.stdout: "fsmap": { 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "btime": "2026-02-13T09:46:06:498002+0000", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "default_fscid": -1, 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "compat": { 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "compat": {}, 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "ro_compat": {}, 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "incompat": { 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_1": "base v0.20", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_2": "client writeable ranges", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_4": "dir inode in separate object", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_8": "no anchor table", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_9": "file layout v2", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_10": "snaprealm v2", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_11": "minor log segments", 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "feature_flags": { 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "enable_multiple": true, 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "ever_enabled_multiple": true 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "standbys": [], 2026-02-13T09:47:25.519 INFO:tasks.workunit.client.0.trial010.stdout: "filesystems": [] 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_first_committed": 1, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_last_committed": 1, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "auth": { 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 5, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_secrets": 3 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_active": 1, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_unknown": 0, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_osd": 3, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "pool_sum": { 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 52200, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 101, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 1, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 303, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 101, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:47:25.520 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 101, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:47:25.521 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 18, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 18, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "up": 3, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 3, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 0 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum": { 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:47:25.522 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83868, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2092, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 27, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81700, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488932, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036666368, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2142208, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 1529330, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 27713, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83661759 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:47:25.523 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum_by_class": { 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "ssd": { 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 83868, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2092, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 27, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 81700, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314488932, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322036666368, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2142208, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 1529330, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:47:25.524 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 27713, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 83661759 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "pool_stats": [ 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 52200, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 101, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 1, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 303, 2026-02-13T09:47:25.525 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 101, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 101, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:47:25.526 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 1241088, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 1241088, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 18, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 18, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "up": 3, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 3, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 3 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "osd_stats": [ 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 146028888074 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:47:25.527 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 38654705679 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 158913789962 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_state": [ 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded", 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num": 1 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "pool_pg_unavailable_map": [ 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": "1", 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "pgs": [] 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_osd": [ 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2147483647, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.528 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 1, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 0, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": [ 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": {} 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "servicemap": { 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 3, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:47:14.893141+0000", 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "services": { 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "osd": { 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "daemons": { 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "summary": "", 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "0": { 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:47:25.529 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "2": { 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_first_committed": 1, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_last_committed": 40, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "logm_first_committed": 1, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "logm_last_committed": 228, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "paxos": { 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 319, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "last_pn": 0, 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: "accepted_pn": 0 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:47:25.530 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.0 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:47:25.531 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 0 --op log --pgid 1.0 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=0 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/0 2026-02-13T09:47:25.577 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/0 --op log --pgid 1.0 2026-02-13T09:47:25.768 INFO:tasks.workunit.client.0.trial010.stderr:PG '1.0' not found 2026-02-13T09:47:25.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-13T09:47:25.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 0 2026-02-13T09:47:25.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:47:25.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/0 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/0' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/0/journal' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:47:25.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:47:25.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/0 2026-02-13T09:47:25.883 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:47:25.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:47:25.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/0 --osd-journal=td/divergent-priors/0/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:47:25.884 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/0/whoami 2026-02-13T09:47:25.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:47:25.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:47:25.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:47:25.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:47:25.906 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:25.900+0000 7f01f6a0aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:47:25.908 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:25.904+0000 7f01f6a0aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:47:25.909 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:25.904+0000 7f01f6a0aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:47:26.098 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:47:26.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:47:26.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:47:26.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:47:26.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:47:26.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:47:26.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:47:26.099 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:47:26.100 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:47:26.100 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:47:26.273 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:26.268+0000 7f01f6a0aa40 -1 Falling back to public interface 2026-02-13T09:47:26.314 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 34 up_thru 39 down_at 28 last_clean_interval [5,26) [v2:127.0.0.1:6800/3945366505,v1:127.0.0.1:6801/3945366505] [v2:127.0.0.1:6802/3945366505,v1:127.0.0.1:6803/3945366505] exists,up a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d 2026-02-13T09:47:26.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:47:26.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:330: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:332: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.2 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:47:26.316 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:47:26.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:47:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:333: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 2 --op log --pgid 1.0 2026-02-13T09:47:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T09:47:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T09:47:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=2 2026-02-13T09:47:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T09:47:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/2 2026-02-13T09:47:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/2 --op log --pgid 1.0 2026-02-13T09:47:26.613 INFO:tasks.workunit.client.0.trial010.stderr:PG '1.0' not found 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:334: TEST_divergent_ec: activate_osd td/divergent-priors 2 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/2 2026-02-13T09:47:26.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/2' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/2/journal' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:47:26.732 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:47:26.733 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:47:26.734 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/2 2026-02-13T09:47:26.734 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:47:26.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:47:26.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/2 --osd-journal=td/divergent-priors/2/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:47:26.735 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/2/whoami 2026-02-13T09:47:26.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:47:26.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:47:26.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:47:26.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:47:26.748 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:26.744+0000 7fb213bc7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:47:26.750 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:26.744+0000 7fb213bc7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:47:26.750 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:26.744+0000 7fb213bc7a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:47:26.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:47:26.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:47:26.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:47:26.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:47:26.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:47:26.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:47:26.951 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:47:26.951 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:47:26.952 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:47:26.952 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:47:27.090 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:27.084+0000 7f01f6a0aa40 -1 osd.0 40 log_to_monitors true 2026-02-13T09:47:27.164 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 37 up_thru 0 down_at 30 last_clean_interval [13,26) [v2:127.0.0.1:6810/1174296324,v1:127.0.0.1:6811/1174296324] [v2:127.0.0.1:6812/1174296324,v1:127.0.0.1:6813/1174296324] exists,up c2b38857-0f58-41fb-bc69-79b08112b08b 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:336: TEST_divergent_ec: _objectstore_tool_nodown td/divergent-priors 1 --op log --pgid 1.0 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1248: _objectstore_tool_nodown: local dir=td/divergent-priors 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1249: _objectstore_tool_nodown: shift 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1250: _objectstore_tool_nodown: local id=1 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1251: _objectstore_tool_nodown: shift 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1252: _objectstore_tool_nodown: local osd_data=td/divergent-priors/1 2026-02-13T09:47:27.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1255: _objectstore_tool_nodown: ceph-objectstore-tool --data-path td/divergent-priors/1 --op log --pgid 1.0 2026-02-13T09:47:27.201 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:27.196+0000 7fb213bc7a40 -1 Falling back to public interface 2026-02-13T09:47:27.374 INFO:tasks.workunit.client.0.trial010.stderr:PG '1.0' not found 2026-02-13T09:47:27.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1256: _objectstore_tool_nodown: return 1 2026-02-13T09:47:27.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: WAIT_FOR_CLEAN_TIMEOUT=20 2026-02-13T09:47:27.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:338: TEST_divergent_ec: wait_for_clean 2026-02-13T09:47:27.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:47:27.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:47:27.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:47:27.476 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 20 .1 2026-02-13T09:47:27.477 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:47:27.477 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:47:27.477 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:47:27.477 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:47:27.477 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:47:27.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '7.3') 2026-02-13T09:47:27.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:47:27.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:47:27.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:47:27.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:47:27.538 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:47:27.758 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:47:27.758 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:47:27.758 INFO:tasks.workunit.client.0.trial010.stderr:2' 2026-02-13T09:47:27.758 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:47:27.758 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:47:27.758 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:47:27.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=184683593731 2026-02-13T09:47:27.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 184683593731 2026-02-13T09:47:27.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-184683593731' 2026-02-13T09:47:27.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:47:27.840 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:47:27.903 INFO:tasks.workunit.client.0.trial010.stderr:Error ENXIO: problem getting command descriptions from osd.1 2026-02-13T09:47:27.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq= 2026-02-13T09:47:27.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z '' 2026-02-13T09:47:27.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2261: flush_pg_stats: continue 2026-02-13T09:47:27.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:47:27.906 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:47:27.993 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:47:27.988+0000 7fb213bc7a40 -1 osd.2 40 log_to_monitors true 2026-02-13T09:47:32.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=201863462915 2026-02-13T09:47:32.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 201863462915 2026-02-13T09:47:32.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-184683593731 2-201863462915' 2026-02-13T09:47:32.990 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:47:32.991 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-184683593731 2026-02-13T09:47:32.991 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:47:32.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:47:32.993 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-184683593731 2026-02-13T09:47:32.993 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:47:32.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=184683593731 2026-02-13T09:47:32.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 184683593731' 2026-02-13T09:47:32.995 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 184683593731 2026-02-13T09:47:32.995 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:47:33.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 184683593732 -lt 184683593731 2026-02-13T09:47:33.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:47:33.211 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-201863462915 2026-02-13T09:47:33.211 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:47:33.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:47:33.213 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-201863462915 2026-02-13T09:47:33.213 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:47:33.214 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=201863462915 2026-02-13T09:47:33.214 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 201863462915' 2026-02-13T09:47:33.215 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 201863462915 2026-02-13T09:47:33.215 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:47:33.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 201863462915 2026-02-13T09:47:33.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:47:34.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:47:34.442 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:47:34.659 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 201863462915 2026-02-13T09:47:34.659 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:47:35.660 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T09:47:35.661 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:47:35.879 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 201863462916 -lt 201863462915 2026-02-13T09:47:35.879 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:47:35.880 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:35.880 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:36.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:47:36.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:36.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:36.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:36.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:36.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:36.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:36.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:36.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:36.374 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:36.374 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:36.374 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:36.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:36.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' -1 2026-02-13T09:47:36.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1665: wait_for_clean: loop=0 2026-02-13T09:47:36.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1666: wait_for_clean: num_active_clean=0 2026-02-13T09:47:36.663 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:36.663 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.1 2026-02-13T09:47:36.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:36.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:36.764 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:36.764 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:36.764 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:36.764 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:36.765 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:36.765 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:36.982 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:36.982 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:36.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:36.983 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:37.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:37.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:37.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:37.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:37.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:37.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:37.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:37.276 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:37.276 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:37.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:37.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:37.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 1 >= 8 )) 2026-02-13T09:47:37.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:37.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.2 2026-02-13T09:47:37.762 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:37.762 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:37.763 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:37.763 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:37.763 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:37.763 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:37.763 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:37.763 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:37.977 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:37.978 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:37.978 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:37.978 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:38.266 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:38.267 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:38.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:38.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:38.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 2 >= 8 )) 2026-02-13T09:47:38.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:38.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.4 2026-02-13T09:47:38.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:38.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:38.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:38.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:38.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:38.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:38.949 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:38.950 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:39.168 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:39.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:39.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:39.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:39.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:39.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:39.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:39.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:39.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:39.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:39.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:39.458 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:39.458 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:39.750 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:39.750 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:39.750 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 3 >= 8 )) 2026-02-13T09:47:39.750 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:39.750 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 0.8 2026-02-13T09:47:40.551 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:40.551 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:40.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:40.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:40.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:40.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:40.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:40.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:40.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:40.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:40.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:40.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:41.057 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:41.058 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:41.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:41.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:41.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 4 >= 8 )) 2026-02-13T09:47:41.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:41.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 1.6 2026-02-13T09:47:42.937 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:42.937 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:42.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:42.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:42.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:42.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:42.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:42.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:43.158 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:43.158 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:43.159 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:43.159 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:43.451 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:43.452 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:43.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:43.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:43.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 5 >= 8 )) 2026-02-13T09:47:43.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:43.735 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 3.2 2026-02-13T09:47:46.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:46.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:46.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:46.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:46.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:46.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:46.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:46.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:47.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:47.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:47.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:47.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:47.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:47.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:47.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:47.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:47.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:47.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:47.429 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:47.429 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:47.429 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:47.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:47.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:47.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 6 >= 8 )) 2026-02-13T09:47:47.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:47.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 6.4 2026-02-13T09:47:54.110 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:47:54.110 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:47:54.111 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:47:54.111 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:47:54.111 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:47:54.111 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:47:54.111 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:47:54.111 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:47:54.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:47:54.326 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:47:54.326 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:47:54.327 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:47:54.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:47:54.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:47:54.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:47:54.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:47:54.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:47:54.616 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:47:54.617 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:47:54.617 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:47:54.617 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:47:54.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:47:54.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:47:54.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 7 >= 8 )) 2026-02-13T09:47:54.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1674: wait_for_clean: eval 2026-02-13T09:47:54.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1675: wait_for_clean: sleep 7.3 2026-02-13T09:48:02.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1676: wait_for_clean: loop+=1 2026-02-13T09:48:02.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:48:02.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:48:02.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:48:02.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:48:02.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:48:02.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:48:02.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:48:02.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=0 2026-02-13T09:48:02.423 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:48:02.424 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:48:02.424 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:48:02.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 0 = 1 2026-02-13T09:48:02.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1664: wait_for_clean: test 0 '!=' 0 2026-02-13T09:48:02.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1667: wait_for_clean: get_is_making_recovery_progress 2026-02-13T09:48:02.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1325: get_is_making_recovery_progress: local recovery_progress 2026-02-13T09:48:02.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1326: get_is_making_recovery_progress: recovery_progress+='.recovering_keys_per_sec + ' 2026-02-13T09:48:02.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1327: get_is_making_recovery_progress: recovery_progress+='.recovering_bytes_per_sec + ' 2026-02-13T09:48:02.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1328: get_is_making_recovery_progress: recovery_progress+=.recovering_objects_per_sec 2026-02-13T09:48:02.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: ceph --format json status 2026-02-13T09:48:02.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: jq -r '.pgmap | .recovering_keys_per_sec + .recovering_bytes_per_sec + .recovering_objects_per_sec' 2026-02-13T09:48:02.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1330: get_is_making_recovery_progress: local progress=null 2026-02-13T09:48:02.995 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1331: get_is_making_recovery_progress: test null '!=' null 2026-02-13T09:48:02.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1669: wait_for_clean: (( 8 >= 8 )) 2026-02-13T09:48:02.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1670: wait_for_clean: ceph report 2026-02-13T09:48:03.283 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_fingerprint": "e3c445a1-133f-4e56-bdf5-f0d5898c3131", 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "version": "20.2.0-636-g3b40640f", 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "commit": "3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb", 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "timestamp": "2026-02-13T09:48:03.280026+0000", 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "tag": "", 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "health": { 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "status": "HEALTH_WARN", 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "checks": { 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "OSDMAP_FLAGS": { 2026-02-13T09:48:03.284 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "message": "nodown,noout,noin flag(s) set", 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "count": 17 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [], 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "OSD_DOWN": { 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "message": "1 osds down", 2026-02-13T09:48:03.285 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: "message": "osd.1 (root=default,host=trial010) is down" 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: "PG_DEGRADED": { 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: "severity": "HEALTH_WARN", 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: "summary": { 2026-02-13T09:48:03.286 INFO:tasks.workunit.client.0.trial010.stdout: "message": "Degraded data redundancy: 101/303 objects degraded (33.333%), 1 pg degraded", 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: "count": 1 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: "detail": [ 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: "message": "pg 1.0 is active+undersized+degraded, acting [NONE,0,2]" 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: "muted": false 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: "mutes": [] 2026-02-13T09:48:03.287 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_first_committed": 1, 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "monmap_last_committed": 1, 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "monmap": { 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:46:06.398286Z", 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:46:06.398286Z", 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release": 20, 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "min_mon_release_name": "tentacle", 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "election_strategy": 1, 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "disallowed_leaders": "", 2026-02-13T09:48:03.288 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": false, 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "tiebreaker_mon": "", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "removed_ranks": "", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "features": { 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "persistent": [ 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "kraken", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "luminous", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "mimic", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap-prune", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "nautilus", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "octopus", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "pacific", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "elector-pinging", 2026-02-13T09:48:03.289 INFO:tasks.workunit.client.0.trial010.stdout: "quincy", 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "reef", 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "squid", 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "tentacle", 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "nvmeof_beacon_diff" 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "optional": [] 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "mons": [ 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "rank": 0, 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "name": "a", 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:48:03.290 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115", 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 0 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:7115/0", 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:7115/0", 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "priority": 0, 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 0, 2026-02-13T09:48:03.291 INFO:tasks.workunit.client.0.trial010.stdout: "crush_location": "{}" 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "quorum": [ 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: 0 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap": { 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 48, 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "fsid": "6766e2ef-d284-4a20-9bf2-1ba278ccdc06", 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "created": "2026-02-13T09:46:06.498241+0000", 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:47:28.381454+0000", 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "last_up_change": "2026-02-13T09:47:28.278979+0000", 2026-02-13T09:48:03.292 INFO:tasks.workunit.client.0.trial010.stdout: "last_in_change": "2026-02-13T09:46:50.528568+0000", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "flags": "nodown,noout,noin,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "flags_num": 5800384, 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "flags_set": [ 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "nodown", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "noin", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "noout", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "pglog_hardlimit", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snapdirs", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "recovery_deletes", 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "sortbitwise" 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "crush_version": 12, 2026-02-13T09:48:03.293 INFO:tasks.workunit.client.0.trial010.stdout: "full_ratio": 0.99000000953674316, 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "backfillfull_ratio": 0.99000000953674316, 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "nearfull_ratio": 0.85000002384185791, 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_snapshot": "", 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "pool_max": 1, 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "max_osd": 3, 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "require_min_compat_client": "luminous", 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "min_compat_client": "jewel", 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "require_osd_release": "tentacle", 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "allow_crimson": false, 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "pools": [ 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "pool_name": "test", 2026-02-13T09:48:03.294 INFO:tasks.workunit.client.0.trial010.stdout: "create_time": "2026-02-13T09:46:18.784061+0000", 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "flags": 16389, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "flags_names": "hashpspool,ec_overwrites,pool_snaps", 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "type": 3, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "size": 3, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "min_size": 2, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "crush_rule": 1, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_count": 0, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_target": 0, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_barrier": 0, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "is_stretch_pool": false, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "object_hash": 2, 2026-02-13T09:48:03.295 INFO:tasks.workunit.client.0.trial010.stdout: "pg_autoscale_mode": "off", 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num": 1, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num": 1, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "pg_placement_num_target": 1, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_target": 1, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "pg_num_pending": 1, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "last_pg_merge_meta": { 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "source_pgid": "0.0", 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "ready_epoch": 0, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_started": 0, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": 0, 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "source_version": "0'0", 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: "target_version": "0'0" 2026-02-13T09:48:03.296 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "last_change": "27", 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend": "0", 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_prenautilus": "0", 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "last_force_op_resend_preluminous": "0", 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "auid": 0, 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "snap_mode": "pool", 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "snap_seq": 1, 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "snap_epoch": 27, 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "pool_snaps": [ 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "snapid": 1, 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "stamp": "2026-02-13T09:46:34.637627+0000", 2026-02-13T09:48:03.297 INFO:tasks.workunit.client.0.trial010.stdout: "name": "snap1" 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps": "[]", 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_bytes": 0, 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "quota_max_objects": 0, 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "tiers": [], 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "tier_of": -1, 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "read_tier": -1, 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "write_tier": -1, 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "cache_mode": "none", 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_bytes": 0, 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "target_max_objects": 0, 2026-02-13T09:48:03.298 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_ratio_micro": 400000, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "cache_target_full_ratio_micro": 800000, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_flush_age": 0, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "cache_min_evict_age": 0, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profile": "myprofile", 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_params": { 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "type": "none" 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_period": 0, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_count": 0, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "use_gmt_hitset": true, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "min_read_recency_for_promote": 0, 2026-02-13T09:48:03.299 INFO:tasks.workunit.client.0.trial010.stdout: "min_write_recency_for_promote": 0, 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_grade_decay_rate": 0, 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "hit_set_search_last_n": 0, 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "grade_table": [], 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "stripe_width": 8192, 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "expected_num_objects": 0, 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "fast_read": false, 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "nonprimary_shards": "{}", 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "options": {}, 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "application_metadata": {} 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: "osds": [ 2026-02-13T09:48:03.300 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d", 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 34, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 40, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 43, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 47, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 42, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:48:03.301 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6800", 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6801", 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.302 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6802", 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6803", 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.303 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6806", 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6807", 2026-02-13T09:48:03.304 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6804", 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.305 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6805", 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3216694393 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6801/3216694393", 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6803/3216694393", 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6807/3216694393", 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6805/3216694393", 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.306 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "f9e827ba-9d6b-472f-8dcb-7869378e766b", 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "up": 0, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 0, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 0, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 9, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 22, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 29, 2026-02-13T09:48:03.307 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.308 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.309 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.310 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.311 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3119946980 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/3119946980", 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/3119946980", 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3119946980", 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3119946980", 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: "exists" 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.312 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "uuid": "c2b38857-0f58-41fb-bc69-79b08112b08b", 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "up": 1, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "in": 1, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 1, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "primary_affinity": 1, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_begin": 37, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "last_clean_end": 40, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 47, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "up_thru": 0, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "down_at": 46, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "lost_at": 0, 2026-02-13T09:48:03.313 INFO:tasks.workunit.client.0.trial010.stdout: "public_addrs": { 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6810", 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6811", 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.314 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addrs": { 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6812", 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6813", 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.315 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addrs": { 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6816", 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6817", 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.316 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addrs": { 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "addrvec": [ 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v2", 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6814", 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "type": "v1", 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "127.0.0.1:6815", 2026-02-13T09:48:03.317 INFO:tasks.workunit.client.0.trial010.stdout: "nonce": 3825576077 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "public_addr": "127.0.0.1:6811/3825576077", 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "cluster_addr": "127.0.0.1:6813/3825576077", 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_back_addr": "127.0.0.1:6817/3825576077", 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "heartbeat_front_addr": "127.0.0.1:6815/3825576077", 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "state": [ 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "exists", 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "up" 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.318 INFO:tasks.workunit.client.0.trial010.stdout: "osd_xinfo": [ 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:47:27.238646+0000", 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:46:10.279009+0000", 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:46:45.567815+0000", 2026-02-13T09:48:03.319 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "0.000000", 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "down_stamp": "2026-02-13T09:47:28.177041+0000", 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_probability": 0, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "laggy_interval": 0, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "features": 4544132024016699391, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "old_weight": 0, 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "last_purged_snaps_scrub": "2026-02-13T09:46:17.661249+0000", 2026-02-13T09:48:03.320 INFO:tasks.workunit.client.0.trial010.stdout: "dead_epoch": 0 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap": [], 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_items": [], 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "pg_upmap_primaries": [], 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "pg_temp": [], 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "primary_temp": [], 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "blocklist": {}, 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "range_blocklist": {}, 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "erasure_code_profiles": { 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "default": { 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "m": "2", 2026-02-13T09:48:03.321 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "myprofile": { 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "crush-device-class": "", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "crush-failure-domain": "osd", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "crush-num-failure-domains": "0", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "crush-osds-per-failure-domain": "0", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "crush-root": "default", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "k": "2", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "m": "1", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "plugin": "isa", 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "technique": "reed_sol_van" 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.322 INFO:tasks.workunit.client.0.trial010.stdout: "removed_snaps_queue": [], 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "new_removed_snaps": [], 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "new_purged_snaps": [], 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "crush_node_flags": {}, 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "device_class_flags": {}, 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode": { 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_enabled": false, 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_bucket_count": 0, 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "degraded_stretch_mode": 0, 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "recovering_stretch_mode": 0, 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "stretch_mode_bucket": 0 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: "osd_metadata": [ 2026-02-13T09:48:03.323 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6802/3216694393,v1:127.0.0.1:6803/3216694393]", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:48:03.324 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/0/block", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:46:07.446198Z", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:48:03.325 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6800/3216694393,v1:127.0.0.1:6801/3216694393]", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6806/3216694393,v1:127.0.0.1:6807/3216694393]", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6804/3216694393,v1:127.0.0.1:6805/3216694393]", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:48:03.326 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/0", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/3119946980,v1:127.0.0.1:6813/3119946980]", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:48:03.327 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/1/block", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:48:03.328 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:46:11.236901Z", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/3119946980,v1:127.0.0.1:6811/3119946980]", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3119946980,v1:127.0.0.1:6817/3119946980]", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3119946980,v1:127.0.0.1:6815/3119946980]", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:48:03.329 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/1", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "arch": "x86_64", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "back_addr": "[v2:127.0.0.1:6812/3825576077,v1:127.0.0.1:6813/3825576077]", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "back_iface": "", 2026-02-13T09:48:03.330 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs": "1", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_db": "0", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_dedicated_wal": "0", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluefs_single_shared_device": "1", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocation_from_file": "1", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_allocator": "hybrid", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_access_mode": "file", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_block_size": "4096", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_devices": "nvme0n1", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_driver": "KernelDevice", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_optimal_io_size": "4096", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_path": "td/divergent-priors/2/block", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_rotational": "0", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_size": "107374182400", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_support_discard": "1", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_bdev_type": "ssd", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_min_alloc_size": "4096", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_onode_segmentation": "inactive", 2026-02-13T09:48:03.331 INFO:tasks.workunit.client.0.trial010.stdout: "bluestore_write_mode": "classic", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_release": "tentacle", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_short": "20.2.0-636-g3b40640f", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "ceph_version_when_created": "ceph version 20.2.0-636-g3b40640f (3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb) tentacle (stable - None)", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "cpu": "AMD EPYC 4464P 12-Core Processor", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "created_at": "2026-02-13T09:46:15.336849Z", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "default_device_class": "ssd", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "device_ids": "nvme0n1=Micron_7450_MTFDKBA960TFR_25174FCD695A", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "device_paths": "nvme0n1=/dev/disk/by-path/pci-0000:02:00.0-nvme-1", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "devices": "nvme0n1", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "distro": "ubuntu", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "distro_description": "Ubuntu 22.04.5 LTS", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "distro_version": "22.04", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "front_addr": "[v2:127.0.0.1:6810/3825576077,v1:127.0.0.1:6811/3825576077]", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "front_iface": "", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "hb_back_addr": "[v2:127.0.0.1:6816/3825576077,v1:127.0.0.1:6817/3825576077]", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "hb_front_addr": "[v2:127.0.0.1:6814/3825576077,v1:127.0.0.1:6815/3825576077]", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "hostname": "trial010", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "journal_rotational": "0", 2026-02-13T09:48:03.332 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_description": "#180-Ubuntu SMP Fri Jan 9 16:10:31 UTC 2026", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "kernel_version": "5.15.0-170-generic", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "mem_swap_kb": "8388604", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "mem_total_kb": "130961692", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "network_numa_unknown_ifaces": "back_iface,front_iface", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_node": "0", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "objectstore_numa_nodes": "0", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "os": "Linux", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "osd_data": "td/divergent-priors/2", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "osd_objectstore": "bluestore", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "osdspec_affinity": "", 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "rotational": "0" 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_clean_epochs": { 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "min_last_epoch_clean": 25, 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "last_epoch_clean": { 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "per_pool": [ 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:48:03.333 INFO:tasks.workunit.client.0.trial010.stdout: "floor": 25 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "osd_epochs": [ 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 44 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 48 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_first_committed": 1, 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "osdmap_last_committed": 48, 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "crushmap": { 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: "devices": [ 2026-02-13T09:48:03.334 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.0", 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.1", 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd.2", 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "class": "ssd" 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "types": [ 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 0, 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: "name": "osd" 2026-02-13T09:48:03.335 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "name": "host" 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 2, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "name": "chassis" 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 3, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "name": "rack" 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 4, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "name": "row" 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 5, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pdu" 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.336 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 6, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "name": "pod" 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 7, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "name": "room" 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 8, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "name": "datacenter" 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 9, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "name": "zone" 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 10, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: "name": "region" 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.337 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "name": "root" 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "buckets": [ 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "id": -1, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "id": -2, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "name": "default~ssd", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 11, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "root", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.338 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "id": -3, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "id": -4, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "name": "trial010~ssd", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "type_id": 1, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "type_name": "host", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 19206, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "alg": "straw2", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "hash": "rjenkins1", 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "items": [ 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "id": 0, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 0 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "id": 1, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:48:03.339 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 1 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "id": 2, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "weight": 6402, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "pos": 2 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "rules": [ 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 0, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "replicated_rule", 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "type": 1, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_firstn", 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "rule_id": 1, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "rule_name": "test", 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "type": 3, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "steps": [ 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "op": "set_chooseleaf_tries", 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "num": 5 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "op": "set_choose_tries", 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "num": 100 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "op": "take", 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "item": -1, 2026-02-13T09:48:03.340 INFO:tasks.workunit.client.0.trial010.stdout: "item_name": "default" 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "op": "choose_indep", 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "num": 0, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "type": "osd" 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stderr:report 3009620449 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "op": "emit" 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: ] 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "tunables": { 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_tries": 0, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "choose_local_fallback_tries": 0, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "choose_total_tries": 50, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_descend_once": 1, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_vary_r": 1, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "chooseleaf_stable": 1, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "msr_descents": 100, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "msr_collision_tries": 100, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "straw_calc_version": 1, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "allowed_bucket_algs": 54, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "profile": "jewel", 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "optimal_tunables": 1, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "legacy_tunables": 0, 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "minimum_required_version": "jewel", 2026-02-13T09:48:03.341 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables2": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "has_v2_rules": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables3": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "has_v3_rules": 0, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "has_v4_buckets": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "require_feature_tunables5": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "has_v5_rules": 0, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "has_msr_rules": 0 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "choose_args": {} 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "fsmap": { 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "btime": "2026-02-13T09:46:06:498002+0000", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "default_fscid": -1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "compat": { 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "compat": {}, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "ro_compat": {}, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "incompat": { 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_1": "base v0.20", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_2": "client writeable ranges", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_3": "default file layouts on dirs", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_4": "dir inode in separate object", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_5": "mds uses versioned encoding", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_6": "dirfrag is stored in omap", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_8": "no anchor table", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_9": "file layout v2", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_10": "snaprealm v2", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_11": "minor log segments", 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_12": "quiesce subvolumes" 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "feature_flags": { 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "enable_multiple": true, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "ever_enabled_multiple": true 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "standbys": [], 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "filesystems": [] 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_first_committed": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "mdsmap_last_committed": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "auth": { 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:48:03.342 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 5, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_secrets": 3 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_active": 1, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_unknown": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_osd": 3, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "pool_sum": { 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 52200, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 101, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 1, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 303, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 101, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 101, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:48:03.343 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 18, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 18, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "up": 3, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 3, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 0 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum": { 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 85020, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2220, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 30, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 82721, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314487780, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322035486720, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2273280, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 1583270, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 31599, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 84706449 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.344 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "osd_sum_by_class": { 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "ssd": { 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "up_from": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_pgs": 3, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_osds": 3, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_osds": 3, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_per_pool_omap_osds": 3, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "kb": 314572800, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used": 85020, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_data": 2220, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_omap": 30, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "kb_used_meta": 82721, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "kb_avail": 314487780, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "statfs": { 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "total": 322122547200, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "available": 322035486720, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 2273280, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 1583270, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 31599, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 84706449 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "hb_peers": [], 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "snap_trim_queue_len": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_snap_trimming": 0, 2026-02-13T09:48:03.345 INFO:tasks.workunit.client.0.trial010.stdout: "num_shards_repaired": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "op_queue_age_hist": { 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "histogram": [], 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "upper_bound": 1 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "perf_stat": { 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ms": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ms": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "commit_latency_ns": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "apply_latency_ns": 0 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "alerts": [], 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "network_ping_times": [] 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "pool_stats": [ 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": 1, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg": 1, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "stat_sum": { 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes": 52200, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects": 101, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_clones": 1, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_object_copies": 303, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing_on_primary": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_missing": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_degraded": 101, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_misplaced": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_unfound": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_dirty": 101, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_whiteouts": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_read": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_read_kb": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_write": 101, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_write_kb": 101, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_scrub_errors": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_shallow_scrub_errors": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_deep_scrub_errors": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_recovered": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_recovered": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_keys_recovered": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_omap": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_hit_set_archive": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_bytes_hit_set_archive": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_kb": 0, 2026-02-13T09:48:03.346 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_kb": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_promote": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_high": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_flush_mode_low": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_some": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_evict_mode_full": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_pinned": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_legacy_snapsets": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_large_omap_objects": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_manifest": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_bytes": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_omap_keys": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_objects_repaired": 0 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "store_stats": { 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "total": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "available": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "internally_reserved": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "allocated": 1241088, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "data_stored": 1241088, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_allocated": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "data_compressed_original": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "omap_allocated": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "internal_metadata": 0 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "log_size": 18, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "ondisk_log_size": 18, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "up": 3, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "acting": 3, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "num_store_stats": 3 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "osd_stats": [ 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 184683593738 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 38654705679 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: "seq": 201863462921 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.347 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_state": [ 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "state": "active+undersized+degraded", 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num": 1 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "pool_pg_unavailable_map": [ 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "poolid": "1", 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "pgs": [] 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_pg_by_osd": [ 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2147483647, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 2, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 0, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 1, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 1, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "osd": 1, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_primary_pg": 0, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_acting_pg": 0, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "num_up_not_acting_pg": 0 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": [ 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "pool": 1, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "purged_snaps": {} 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: ], 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "servicemap": { 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "epoch": 3, 2026-02-13T09:48:03.348 INFO:tasks.workunit.client.0.trial010.stdout: "modified": "2026-02-13T09:47:14.893141+0000", 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "services": { 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "osd": { 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "daemons": { 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "summary": "", 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "0": { 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "2": { 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "start_epoch": 0, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "start_stamp": "0.000000", 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "gid": 0, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "addr": "(unrecognized address family 0)/0", 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "metadata": {}, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "task_status": {} 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: }, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_first_committed": 1, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "mgrstat_last_committed": 59, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "logm_first_committed": 1, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "logm_last_committed": 312, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "paxos": { 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "first_committed": 1, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "last_committed": 430, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "last_pn": 0, 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: "accepted_pn": 0 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout: } 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1671: wait_for_clean: return 1 2026-02-13T09:48:03.349 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery 2026-02-13T09:48:03.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:341: TEST_divergent_ec: echo 'delay recovery' 2026-02-13T09:48:03.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:342: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:03.496 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:03.496 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T09:47:28.389998+0000 40'102 48:139 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:24:29.039733+0000 0 0 2026-02-13T09:48:03.496 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:03.496 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:03.496 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:03.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:48:03.506 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.0 2026-02-13T09:48:03.506 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.0 2026-02-13T09:48:03.506 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.0 ']' 2026-02-13T09:48:03.506 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:48:03.506 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:03.506 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:48:03.506 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.0.asok 2026-02-13T09:48:03.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T09:48:03.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.0.asok set_recovery_delay 100000 2026-02-13T09:48:03.563 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:48:03.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:343: TEST_divergent_ec: for i in $non_divergent 2026-02-13T09:48:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: get_asok_path osd.2 2026-02-13T09:48:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.2 2026-02-13T09:48:03.569 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.2 ']' 2026-02-13T09:48:03.569 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:48:03.569 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:03.569 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:48:03.570 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.2.asok 2026-02-13T09:48:03.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T09:48:03.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:345: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.2.asok set_recovery_delay 100000 2026-02-13T09:48:03.624 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:48:03.630 INFO:tasks.workunit.client.0.trial010.stdout:revive divergent 1 2026-02-13T09:48:03.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:349: TEST_divergent_ec: echo 'revive divergent 1' 2026-02-13T09:48:03.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:350: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:03.847 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:03.847 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T09:47:28.389998+0000 40'102 48:139 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:24:29.039733+0000 0 0 2026-02-13T09:48:03.847 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:03.847 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:03.847 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:03.856 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:351: TEST_divergent_ec: ceph osd set noup 2026-02-13T09:48:04.183 INFO:tasks.workunit.client.0.trial010.stderr:noup is set 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:352: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:48:04.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:48:04.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:48:04.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:04.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:04.196 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:04.196 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:04.196 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:48:04.196 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:04.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:04.199 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:48:04.199 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:48:04.199 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:48:04.199 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:48:04.200 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:48:04.200 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:04.200 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:48:04.200 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:48:04.201 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:48:04.201 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:48:04.201 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:48:04.223 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:04.215+0000 7ff60dfe5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:04.225 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:04.219+0000 7ff60dfe5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:04.226 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:04.219+0000 7ff60dfe5a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:04.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:871: activate_osd: return 0 2026-02-13T09:48:04.415 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:353: TEST_divergent_ec: sleep 5 2026-02-13T09:48:04.614 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:04.607+0000 7ff60dfe5a40 -1 Falling back to public interface 2026-02-13T09:48:05.263 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:05.255+0000 7ff60dfe5a40 -1 osd.1 27 log_to_monitors true 2026-02-13T09:48:09.416 INFO:tasks.workunit.client.0.trial010.stdout:delay recovery divergent 2026-02-13T09:48:09.417 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:355: TEST_divergent_ec: echo 'delay recovery divergent' 2026-02-13T09:48:09.417 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:356: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:09.617 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:09.617 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T09:47:28.389998+0000 40'102 51:145 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:24:29.039733+0000 0 0 2026-02-13T09:48:09.617 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:09.617 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:09.618 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:09.628 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: get_asok_path osd.1 2026-02-13T09:48:09.628 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=osd.1 2026-02-13T09:48:09.628 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n osd.1 ']' 2026-02-13T09:48:09.629 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:48:09.629 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:09.630 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:48:09.630 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.16079/ceph-osd.1.asok 2026-02-13T09:48:09.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: CEPH_ARGS= 2026-02-13T09:48:09.630 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:357: TEST_divergent_ec: ceph --admin-daemon /tmp/ceph-asok.16079/ceph-osd.1.asok set_recovery_delay 100000 2026-02-13T09:48:09.695 INFO:tasks.workunit.client.0.trial010.stdout:set_recovery_delay: set osd_recovery_delay_start to 100000 2026-02-13T09:48:09.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:359: TEST_divergent_ec: ceph osd unset noup 2026-02-13T09:48:10.020 INFO:tasks.workunit.client.0.trial010.stderr:noup is unset 2026-02-13T09:48:10.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:361: TEST_divergent_ec: wait_for_osd up 0 2026-02-13T09:48:10.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:10.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:48:10.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:10.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:10.032 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:10.033 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:10.033 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:10.033 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:10.034 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:48:10.256 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 43 up_thru 47 down_at 42 last_clean_interval [34,40) [v2:127.0.0.1:6800/3216694393,v1:127.0.0.1:6801/3216694393] [v2:127.0.0.1:6802/3216694393,v1:127.0.0.1:6803/3216694393] exists,up a2925f43-8d6d-4702-81f0-5cdc3cdf8c2d 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:362: TEST_divergent_ec: wait_for_osd up 1 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:10.258 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:10.259 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:10.259 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:10.259 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:10.259 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:10.259 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:48:10.474 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 53 up_thru 53 down_at 29 last_clean_interval [9,27) [v2:127.0.0.1:6818/83494802,v1:127.0.0.1:6819/83494802] [v2:127.0.0.1:6820/83494802,v1:127.0.0.1:6821/83494802] exists,up f9e827ba-9d6b-472f-8dcb-7869378e766b 2026-02-13T09:48:10.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:10.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:10.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:10.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:363: TEST_divergent_ec: wait_for_osd up 2 2026-02-13T09:48:10.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:10.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:48:10.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:10.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:10.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:10.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:10.476 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:10.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:10.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:48:10.689 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 47 up_thru 0 down_at 46 last_clean_interval [37,40) [v2:127.0.0.1:6810/3825576077,v1:127.0.0.1:6811/3825576077] [v2:127.0.0.1:6812/3825576077,v1:127.0.0.1:6813/3825576077] exists,up c2b38857-0f58-41fb-bc69-79b08112b08b 2026-02-13T09:48:10.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:10.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:10.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:10.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:365: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:10.896 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:10.896 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 0 101 0 0 52200 0 0 18 84 18 active+undersized+degraded 2026-02-13T09:47:28.389998+0000 40'102 51:145 [NONE,0,2] 0 [NONE,0,2] 0 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T14:24:29.039733+0000 0 0 2026-02-13T09:48:10.896 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:10.896 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:10.897 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:10.905 INFO:tasks.workunit.client.0.trial010.stdout:wait for peering 2026-02-13T09:48:10.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:366: TEST_divergent_ec: echo 'wait for peering' 2026-02-13T09:48:10.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:367: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:11.126 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:11.126 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-13T09:48:10.125047+0000 40'102 54:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:48:11.127 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:11.127 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:11.127 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:11.135 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:368: TEST_divergent_ec: rados -p test put foo /tmp/tmp.GbJpAMIyXg 2026-02-13T09:48:11.167 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:369: TEST_divergent_ec: rm -f /tmp/tmp.GbJpAMIyXg 2026-02-13T09:48:11.168 INFO:tasks.workunit.client.0.trial010.stdout:killing divergent 1 2026-02-13T09:48:11.168 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:371: TEST_divergent_ec: echo 'killing divergent 1' 2026-02-13T09:48:11.168 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:372: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:11.375 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:11.375 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-13T09:48:10.125047+0000 40'102 54:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:48:11.375 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:11.375 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:11.375 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:11.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:373: TEST_divergent_ec: kill_daemons td/divergent-priors KILL osd.1 2026-02-13T09:48:11.384 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:48:11.384 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:48:11.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:48:11.384 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:48:11.385 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:48:11.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:48:11.493 INFO:tasks.workunit.client.0.trial010.stdout:reviving divergent 1 2026-02-13T09:48:11.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:375: TEST_divergent_ec: echo 'reviving divergent 1' 2026-02-13T09:48:11.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:376: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:11.694 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:11.694 INFO:tasks.workunit.client.0.trial010.stdout:1.0 101 4 4 0 0 52200 0 0 12 90 12 active+recovering+degraded 2026-02-13T09:48:10.125047+0000 40'102 54:134 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 no scrub is scheduled 0 0 2026-02-13T09:48:11.694 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:11.694 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:11.695 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:377: TEST_divergent_ec: activate_osd td/divergent-priors 1 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/divergent-priors 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/divergent-priors/1 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 ' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/divergent-priors/1' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/divergent-priors/1/journal' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/divergent-priors' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:11.704 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/divergent-priors/$name.log' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/divergent-priors/$name.pid' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:11.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:48:11.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:48:11.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/divergent-priors/1 2026-02-13T09:48:11.707 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:48:11.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:48:11.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=6766e2ef-d284-4a20-9bf2-1ba278ccdc06 --auth-supported=none --mon-host=127.0.0.1:7115 --osd_force_auth_primary_missing_objects=1000000 --osd_debug_pg_log_writeout=true --osd_min_pg_log_entries=12 --osd_max_pg_log_entries=12 --osd_pg_log_trim_min=6 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/divergent-priors/1 --osd-journal=td/divergent-priors/1/journal --chdir= --run-dir=td/divergent-priors '--admin-socket=/tmp/ceph-asok.16079/$cluster-$name.asok' --debug-osd=20 '--log-file=td/divergent-priors/$name.log' '--pid-file=td/divergent-priors/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:11.707 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/divergent-priors/1/whoami 2026-02-13T09:48:11.708 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:48:11.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:48:11.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:48:11.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:48:11.735 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:11.727+0000 7fe95c62da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:11.736 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:11.731+0000 7fe95c62da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:11.737 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:11.731+0000 7fe95c62da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:11.927 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:11.928 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:48:12.139 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 53 up_thru 53 down_at 29 last_clean_interval [9,27) [v2:127.0.0.1:6818/83494802,v1:127.0.0.1:6819/83494802] [v2:127.0.0.1:6820/83494802,v1:127.0.0.1:6821/83494802] exists,up f9e827ba-9d6b-472f-8dcb-7869378e766b 2026-02-13T09:48:12.140 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:12.140 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:12.140 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:12.140 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:379: TEST_divergent_ec: sleep 20 2026-02-13T09:48:12.202 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:12.195+0000 7fe95c62da40 -1 Falling back to public interface 2026-02-13T09:48:12.846 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:12.839+0000 7fe95c62da40 -1 osd.1 55 log_to_monitors true 2026-02-13T09:48:32.141 INFO:tasks.workunit.client.0.trial010.stdout:allowing recovery 2026-02-13T09:48:32.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:381: TEST_divergent_ec: echo 'allowing recovery' 2026-02-13T09:48:32.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:382: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:32.336 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:32.336 INFO:tasks.workunit.client.0.trial010.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-13T09:48:13.211638+0000 55'103 59:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:42:22.806903+0000 0 0 2026-02-13T09:48:32.337 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:32.337 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:32.337 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:32.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-13T09:48:32.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.0 debug kick_recovery_wq 0 2026-02-13T09:48:32.429 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:48:32.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-13T09:48:32.436 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.1 debug kick_recovery_wq 0 2026-02-13T09:48:32.517 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:48:32.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:384: TEST_divergent_ec: for i in $osds 2026-02-13T09:48:32.524 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:386: TEST_divergent_ec: ceph tell osd.2 debug kick_recovery_wq 0 2026-02-13T09:48:32.604 INFO:tasks.workunit.client.0.trial010.stderr:kicking recovery queue. set osd_recovery_delay_start to 0 2026-02-13T09:48:32.611 INFO:tasks.workunit.client.0.trial010.stdout:reading divergent objects 2026-02-13T09:48:32.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:389: TEST_divergent_ec: echo 'reading divergent objects' 2026-02-13T09:48:32.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:390: TEST_divergent_ec: ceph pg dump pgs 2026-02-13T09:48:32.819 INFO:tasks.workunit.client.0.trial010.stdout:PG_STAT OBJECTS MISSING_ON_PRIMARY DEGRADED MISPLACED UNFOUND BYTES OMAP_BYTES* OMAP_KEYS* LOG LOG_DUPS DISK_LOG STATE STATE_STAMP VERSION REPORTED UP UP_PRIMARY ACTING ACTING_PRIMARY LAST_SCRUB SCRUB_STAMP LAST_DEEP_SCRUB DEEP_SCRUB_STAMP SNAPTRIMQ_LEN LAST_SCRUB_DURATION SCRUB_SCHEDULING OBJECTS_SCRUBBED OBJECTS_TRIMMED 2026-02-13T09:48:32.819 INFO:tasks.workunit.client.0.trial010.stdout:1.0 102 0 0 0 0 52712 0 0 13 90 13 active+clean 2026-02-13T09:48:13.211638+0000 55'103 59:160 [1,0,2] 1 [1,0,2] 1 0'0 2026-02-13T09:46:18.877629+0000 0'0 2026-02-13T09:46:18.877629+0000 0 0 periodic scrub scheduled @ 2026-02-14T20:42:22.806903+0000 0 0 2026-02-13T09:48:32.819 INFO:tasks.workunit.client.0.trial010.stdout: 2026-02-13T09:48:32.819 INFO:tasks.workunit.client.0.trial010.stdout:* NOTE: Omap statistics are gathered during deep scrub and may be inaccurate soon afterwards depending on utilization. See http://docs.ceph.com/en/latest/dev/placement-group/#omap-statistics for further details. 2026-02-13T09:48:32.819 INFO:tasks.workunit.client.0.trial010.stderr:dumped pgs 2026-02-13T09:48:32.828 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: expr 2 + 2 2026-02-13T09:48:32.830 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: seq 1 4 2026-02-13T09:48:32.831 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:48:32.831 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_1 td/divergent-priors/existing 2026-02-13T09:48:32.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:48:32.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_2 td/divergent-priors/existing 2026-02-13T09:48:32.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:48:32.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_3 td/divergent-priors/existing 2026-02-13T09:48:32.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:391: TEST_divergent_ec: for i in $(seq 1 $(expr $DIVERGENT_WRITE + $DIVERGENT_REMOVE)) 2026-02-13T09:48:32.909 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:393: TEST_divergent_ec: rados -p test get existing_4 td/divergent-priors/existing 2026-02-13T09:48:32.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:395: TEST_divergent_ec: rm -f td/divergent-priors/existing 2026-02-13T09:48:32.938 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-13T09:48:32.940 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:397: TEST_divergent_ec: grep _merge_object_divergent_entries td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:1 entries: 27'103 (26'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-13T09:46:29.810777+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 20 _merge_object_divergent_entries: keeping 27'103 (26'99) clone 1:7a80c0d5:::existing_99:1 by unknown.0.0:0 2026-02-13T09:46:29.810777+0000 0 snaps [1] ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: true, new_object: false 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version: 26'99 first_divergent_update: 27'103 last_divergent_update: 27'103 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 has no more recent entries in log 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:1 prior_version or op type indicates creation, deleting 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 20 _merge_object_divergent_entries: merging hoid 1:7a80c0d5:::existing_99:head entries: 27'104 (26'99) modify 1:7a80c0d5:::existing_99:head by client.4559.0:1 2026-02-13T09:46:34.711031+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 20 _merge_object_divergent_entries: keeping 27'104 (26'99) modify 1:7a80c0d5:::existing_99:head by client.4559.0:1 2026-02-13T09:46:34.711031+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:48:32.942 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head prior_version: 26'99 first_divergent_update: 27'104 last_divergent_update: 27'104 2026-02-13T09:48:32.943 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head has no more recent entries in log 2026-02-13T09:48:32.943 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:48:32.943 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head olog_can_rollback_to: 27'104 2026-02-13T09:48:32.943 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot rollback 27'104 (26'99) modify 1:7a80c0d5:::existing_99:head by client.4559.0:1 2026-02-13T09:46:34.711031+0000 0 ObjectCleanRegions clean_offsets: [512~18446744073709551103], clean_omap: true, new_object: false 2026-02-13T09:48:32.943 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:7a80c0d5:::existing_99:head cannot roll back, removing and adding to missing 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 20 _merge_object_divergent_entries: merging hoid 1:c156033e:::existing_100:head entries: 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4550.0:1 2026-02-13T09:46:33.640595+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false,26'102 (26'101) modify 1:c156033e:::existing_100:head by client.4556.0:1 2026-02-13T09:46:34.637617+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 20 _merge_object_divergent_entries: keeping 26'101 (26'100) modify 1:c156033e:::existing_100:head by client.4550.0:1 2026-02-13T09:46:33.640595+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 20 _merge_object_divergent_entries: keeping 26'102 (26'101) modify 1:c156033e:::existing_100:head by client.4556.0:1 2026-02-13T09:46:34.637617+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid object_not_in_store: 0 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head prior_version: 26'100 first_divergent_update: 26'101 last_divergent_update: 26'102 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head has no more recent entries in log 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head must be rolled back or recovered, attempting to rollback 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head olog_can_rollback_to: 27'104 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot rollback 26'102 (26'101) modify 1:c156033e:::existing_100:head by client.4556.0:1 2026-02-13T09:46:34.637617+0000 0 ObjectCleanRegions clean_offsets: [1000~18446744073709550615], clean_omap: true, new_object: false 2026-02-13T09:48:32.944 INFO:tasks.workunit.client.0.trial010.stdout:td/divergent-priors/osd.1.log:2026-02-13T09:48:10.091+0000 7ff5ef76a640 10 _merge_object_divergent_entries: hoid 1:c156033e:::existing_100:head cannot roll back, removing and adding to missing 2026-02-13T09:48:32.945 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: find td/divergent-priors -name '*osd*log' 2026-02-13T09:48:32.946 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:406: TEST_divergent_ec: grep -q '_merge_object_divergent_entries.*rolled back' td/divergent-priors/osd.1.log td/divergent-priors/osd.0.log td/divergent-priors/osd.2.log 2026-02-13T09:48:32.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:411: TEST_divergent_ec: echo success 2026-02-13T09:48:32.949 INFO:tasks.workunit.client.0.trial010.stdout:success 2026-02-13T09:48:32.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:413: TEST_divergent_ec: delete_pool test 2026-02-13T09:48:32.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:537: delete_pool: local poolname=test 2026-02-13T09:48:32.950 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:538: delete_pool: ceph osd pool delete test test --yes-i-really-really-mean-it 2026-02-13T09:48:33.212 INFO:tasks.workunit.client.0.trial010.stderr:pool 'test' does not exist 2026-02-13T09:48:33.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:414: TEST_divergent_ec: kill_daemons td/divergent-priors 2026-02-13T09:48:33.222 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:48:33.223 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:48:33.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:48:33.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:48:33.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:48:38.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:48:38.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh:47: run: teardown td/divergent-priors 2026-02-13T09:48:38.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:48:38.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:48:38.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:48:38.538 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:48:38.538 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:48:38.538 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:48:38.538 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:48:38.538 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:48:38.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:48:38.545 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:48:38.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:48:38.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:48:38.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:48:38.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:48:38.548 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:48:38.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:48:38.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:48:38.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:48:38.549 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:48:38.551 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:48:38.552 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:48:38.552 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:48:38.574 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:48:38.574 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.574 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:48:38.574 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:48:38.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:48:38.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:48:38.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-13T09:48:38.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/divergent-priors 0 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/divergent-priors 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/divergent-priors KILL 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:48:38.576 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:48:38.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:48:38.579 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:48:38.580 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:48:38.580 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:48:38.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:48:38.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:48:38.582 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:48:38.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:48:38.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:48:38.583 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:48:38.584 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:48:38.585 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:48:38.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T09:48:38.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/divergent-priors 2026-02-13T09:48:38.587 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:48:38.587 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.588 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.16079 2026-02-13T09:48:38.588 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.16079 2026-02-13T09:48:38.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:48:38.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:48:38.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-13T09:48:38.591 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T09:48:38.591 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T09:48:38.640 INFO:tasks.workunit:Running workunit osd/ec-error-rollforward.sh... 2026-02-13T09:48:38.640 DEBUG:teuthology.orchestra.run.trial010:workunit test osd/ec-error-rollforward.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh 2026-02-13T09:48:38.689 INFO:tasks.workunit.client.0.trial010.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/ec-error-rollforward 2026-02-13T09:48:38.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:6: run: local dir=td/ec-error-rollforward 2026-02-13T09:48:38.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:7: run: shift 2026-02-13T09:48:38.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: export CEPH_MON=127.0.0.1:7132 2026-02-13T09:48:38.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:10: run: CEPH_MON=127.0.0.1:7132 2026-02-13T09:48:38.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:11: run: export CEPH_ARGS 2026-02-13T09:48:38.695 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: uuidgen 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:12: run: CEPH_ARGS+='--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none ' 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:13: run: CEPH_ARGS+='--mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: export margin=10 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:14: run: margin=10 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: export objects=200 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:15: run: objects=200 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: export poolname=test 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:16: run: poolname=test 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: set 2026-02-13T09:48:38.696 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:18: run: local funcs=TEST_ec_error_rollforward 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:19: run: for func in $funcs 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:20: run: setup td/ec-error-rollforward 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/ec-error-rollforward 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/ec-error-rollforward 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:48:38.698 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:48:38.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:48:38.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:48:38.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:48:38.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:48:38.700 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:48:38.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:48:38.702 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:48:38.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:48:38.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:48:38.703 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:48:38.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:48:38.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:48:38.705 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:48:38.705 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:48:38.706 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:48:38.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:48:38.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-13T09:48:38.709 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:48:38.709 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.709 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:38.709 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.71690 2026-02-13T09:48:38.710 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:48:38.710 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:48:38.710 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/ec-error-rollforward 2026-02-13T09:48:38.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:48:38.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:38.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.71690 2026-02-13T09:48:38.714 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:48:38.714 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T09:48:38.714 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T09:48:38.714 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:48:38.714 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/ec-error-rollforward 1' TERM HUP INT 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:21: run: TEST_ec_error_rollforward td/ec-error-rollforward 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:27: TEST_ec_error_rollforward: local dir=td/ec-error-rollforward 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:28: TEST_ec_error_rollforward: run_mon td/ec-error-rollforward a 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/ec-error-rollforward 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/ec-error-rollforward/a 2026-02-13T09:48:38.715 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/ec-error-rollforward/a --run-dir=td/ec-error-rollforward 2026-02-13T09:48:38.738 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:48:38.738 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:38.738 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:38.738 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:38.738 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.738 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:38.739 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:38.739 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/ec-error-rollforward/a '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --mon-cluster-log-file=td/ec-error-rollforward/log --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:48:38.769 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:48:38.770 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:48:38.770 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:48:38.770 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:48:38.770 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:48:38.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:48:38.771 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:48:38.771 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:48:38.771 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:48:38.771 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:48:38.771 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.771 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:38.772 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.71690/ceph-mon.a.asok 2026-02-13T09:48:38.772 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:48:38.772 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.71690/ceph-mon.a.asok config get fsid 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:48:38.828 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:48:38.829 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:48:38.829 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.829 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:38.829 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.71690/ceph-mon.a.asok 2026-02-13T09:48:38.829 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:48:38.829 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.71690/ceph-mon.a.asok config get mon_host 2026-02-13T09:48:38.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:29: TEST_ec_error_rollforward: run_mgr td/ec-error-rollforward x 2026-02-13T09:48:38.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/ec-error-rollforward 2026-02-13T09:48:38.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:48:38.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:48:38.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:48:38.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/ec-error-rollforward/x 2026-02-13T09:48:38.883 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:48:38.991 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:48:38.991 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:38.992 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:38.992 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:38.992 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:38.992 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:38.992 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:38.992 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:48:38.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/ec-error-rollforward/x '--log-file=td/ec-error-rollforward/$name.log' '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --run-dir=td/ec-error-rollforward '--pid-file=td/ec-error-rollforward/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:30: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 0 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/0 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:39.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-13T09:48:39.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-13T09:48:39.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:39.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:48:39.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:39.013 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:48:39.013 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:39.013 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/0 2026-02-13T09:48:39.014 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:48:39.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=7e117159-a579-4f47-94c9-a685d074e6b9 2026-02-13T09:48:39.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 7e117159-a579-4f47-94c9-a685d074e6b9' 2026-02-13T09:48:39.016 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 7e117159-a579-4f47-94c9-a685d074e6b9 2026-02-13T09:48:39.016 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:48:39.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB3845pPthgARAACpQxM1gaQUWHraMEDbXiLA== 2026-02-13T09:48:39.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB3845pPthgARAACpQxM1gaQUWHraMEDbXiLA=="}' 2026-02-13T09:48:39.027 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 7e117159-a579-4f47-94c9-a685d074e6b9 -i td/ec-error-rollforward/0/new.json 2026-02-13T09:48:39.138 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:39.147 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/0/new.json 2026-02-13T09:48:39.148 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB3845pPthgARAACpQxM1gaQUWHraMEDbXiLA== --osd-uuid 7e117159-a579-4f47-94c9-a685d074e6b9 2026-02-13T09:48:39.163 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:39.154+0000 7f27a9971a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:39.164 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:39.154+0000 7f27a9971a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:39.165 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:39.158+0000 7f27a9971a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:39.165 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:39.158+0000 7f27a9971a40 -1 bdev(0x55a35521ec00 td/ec-error-rollforward/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:48:39.166 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:39.158+0000 7f27a9971a40 -1 bluestore(td/ec-error-rollforward/0) _read_fsid unparsable uuid 2026-02-13T09:48:39.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/0/keyring 2026-02-13T09:48:39.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:48:39.921 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:48:39.921 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:48:39.922 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:48:40.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:48:40.040 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:48:40.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:40.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:48:40.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:48:40.041 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:48:40.063 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:40.054+0000 7f3223cc9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:40.065 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:40.058+0000 7f3223cc9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:40.067 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:40.058+0000 7f3223cc9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:40.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:48:40.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:40.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:48:40.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:40.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:40.147 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:40.147 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:40.147 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:40.148 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:40.148 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:48:40.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:48:40.486 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:40.478+0000 7f3223cc9a40 -1 Falling back to public interface 2026-02-13T09:48:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:48:41.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:41.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:48:41.254 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:48:41.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:41.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:48:41.363 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:48:41.487 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:41.478+0000 7f3223cc9a40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:48:42.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:48:42.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:42.365 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:48:42.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:48:42.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:42.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:48:42.582 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3608428394,v1:127.0.0.1:6801/3608428394] [v2:127.0.0.1:6802/3608428394,v1:127.0.0.1:6803/3608428394] exists,up 7e117159-a579-4f47-94c9-a685d074e6b9 2026-02-13T09:48:42.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:42.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:42.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:42.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:31: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 1 2026-02-13T09:48:42.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:42.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/1 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:42.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:48:42.588 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/1 2026-02-13T09:48:42.589 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:48:42.590 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=ebaba7e7-eaed-4566-8e7a-600e3a6e47c1 2026-02-13T09:48:42.590 INFO:tasks.workunit.client.0.trial010.stdout:add osd1 ebaba7e7-eaed-4566-8e7a-600e3a6e47c1 2026-02-13T09:48:42.591 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 ebaba7e7-eaed-4566-8e7a-600e3a6e47c1' 2026-02-13T09:48:42.591 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:48:42.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB6845pI3xqIxAAnELjE/F7FwsPqrtOUyVpsg== 2026-02-13T09:48:42.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB6845pI3xqIxAAnELjE/F7FwsPqrtOUyVpsg=="}' 2026-02-13T09:48:42.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new ebaba7e7-eaed-4566-8e7a-600e3a6e47c1 -i td/ec-error-rollforward/1/new.json 2026-02-13T09:48:42.816 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:48:42.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/1/new.json 2026-02-13T09:48:42.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB6845pI3xqIxAAnELjE/F7FwsPqrtOUyVpsg== --osd-uuid ebaba7e7-eaed-4566-8e7a-600e3a6e47c1 2026-02-13T09:48:42.850 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:42.842+0000 7fe6b1cfea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:42.851 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:42.842+0000 7fe6b1cfea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:42.852 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:42.846+0000 7fe6b1cfea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:42.853 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:42.846+0000 7fe6b1cfea40 -1 bdev(0x557000586c00 td/ec-error-rollforward/1/block) open stat got: (1) Operation not permitted 2026-02-13T09:48:42.853 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:42.846+0000 7fe6b1cfea40 -1 bluestore(td/ec-error-rollforward/1) _read_fsid unparsable uuid 2026-02-13T09:48:43.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/1/keyring 2026-02-13T09:48:43.512 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:48:43.513 INFO:tasks.workunit.client.0.trial010.stdout:adding osd1 key to auth repository 2026-02-13T09:48:43.513 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T09:48:43.513 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:48:43.797 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:48:43.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T09:48:43.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:43.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:48:43.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:48:43.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:48:43.818 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:43.810+0000 7f4faa0f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:43.820 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:43.810+0000 7f4faa0f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:43.820 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:43.814+0000 7f4faa0f1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:44.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T09:48:44.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:44.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:48:44.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:44.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:44.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:44.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:44.013 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:44.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:44.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:48:44.216 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:48:44.222 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:44.214+0000 7f4faa0f1a40 -1 Falling back to public interface 2026-02-13T09:48:44.802 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:44.794+0000 7f4faa0f1a40 -1 osd.1 0 log_to_monitors true 2026-02-13T09:48:45.217 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:48:45.217 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:45.217 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:48:45.218 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:48:45.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:45.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:48:45.435 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1775501216,v1:127.0.0.1:6811/1775501216] [v2:127.0.0.1:6812/1775501216,v1:127.0.0.1:6813/1775501216] exists,up ebaba7e7-eaed-4566-8e7a-600e3a6e47c1 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:32: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 2 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T09:48:45.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/2 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:48:45.440 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:45.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:45.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:45.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:45.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:48:45.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:48:45.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/2 2026-02-13T09:48:45.442 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:48:45.443 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a3557d6e-e184-41dc-a7c1-73f1018fdb62 2026-02-13T09:48:45.443 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 a3557d6e-e184-41dc-a7c1-73f1018fdb62' 2026-02-13T09:48:45.443 INFO:tasks.workunit.client.0.trial010.stdout:add osd2 a3557d6e-e184-41dc-a7c1-73f1018fdb62 2026-02-13T09:48:45.443 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:48:45.451 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQB9845pX4KsGhAAA/NLJrqdBVSQsHeaWmo6Lw== 2026-02-13T09:48:45.452 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQB9845pX4KsGhAAA/NLJrqdBVSQsHeaWmo6Lw=="}' 2026-02-13T09:48:45.452 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a3557d6e-e184-41dc-a7c1-73f1018fdb62 -i td/ec-error-rollforward/2/new.json 2026-02-13T09:48:45.661 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:48:45.670 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/2/new.json 2026-02-13T09:48:45.671 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQB9845pX4KsGhAAA/NLJrqdBVSQsHeaWmo6Lw== --osd-uuid a3557d6e-e184-41dc-a7c1-73f1018fdb62 2026-02-13T09:48:45.685 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:45.678+0000 7f4a4dfc8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:45.687 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:45.678+0000 7f4a4dfc8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:45.688 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:45.678+0000 7f4a4dfc8a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:45.689 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:45.678+0000 7f4a4dfc8a40 -1 bdev(0x5623d319ec00 td/ec-error-rollforward/2/block) open stat got: (1) Operation not permitted 2026-02-13T09:48:45.689 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:45.682+0000 7f4a4dfc8a40 -1 bluestore(td/ec-error-rollforward/2) _read_fsid unparsable uuid 2026-02-13T09:48:46.307 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/2/keyring 2026-02-13T09:48:46.307 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:48:46.308 INFO:tasks.workunit.client.0.trial010.stdout:adding osd2 key to auth repository 2026-02-13T09:48:46.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T09:48:46.309 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:48:46.594 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:48:46.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T09:48:46.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:46.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:48:46.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:48:46.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:48:46.616 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:46.606+0000 7f8459bdfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:46.617 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:46.610+0000 7f8459bdfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:46.618 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:46.610+0000 7f8459bdfa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:46.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T09:48:46.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:46.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:48:46.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:46.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:46.805 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:46.806 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:46.806 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:46.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:46.807 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:48:46.966 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:46.958+0000 7f8459bdfa40 -1 Falling back to public interface 2026-02-13T09:48:47.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:48:47.609 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:47.602+0000 7f8459bdfa40 -1 osd.2 0 log_to_monitors true 2026-02-13T09:48:48.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:48:48.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:48.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:48:48.018 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:48:48.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:48.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:48:48.236 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/945798717,v1:127.0.0.1:6819/945798717] [v2:127.0.0.1:6820/945798717,v1:127.0.0.1:6821/945798717] exists,up a3557d6e-e184-41dc-a7c1-73f1018fdb62 2026-02-13T09:48:48.238 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:33: TEST_ec_error_rollforward: run_osd td/ec-error-rollforward 3 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/ec-error-rollforward/3 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:48:48.239 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/ec-error-rollforward/3 2026-02-13T09:48:48.240 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:48:48.240 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=2bd127f0-fe2c-4e12-9828-b794dc4ad475 2026-02-13T09:48:48.241 INFO:tasks.workunit.client.0.trial010.stdout:add osd3 2bd127f0-fe2c-4e12-9828-b794dc4ad475 2026-02-13T09:48:48.241 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 2bd127f0-fe2c-4e12-9828-b794dc4ad475' 2026-02-13T09:48:48.241 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:48:48.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCA845p7gfeDhAAnzI29HJcaU8vbhyEz+TiKw== 2026-02-13T09:48:48.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCA845p7gfeDhAAnzI29HJcaU8vbhyEz+TiKw=="}' 2026-02-13T09:48:48.253 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 2bd127f0-fe2c-4e12-9828-b794dc4ad475 -i td/ec-error-rollforward/3/new.json 2026-02-13T09:48:48.459 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:48:48.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/ec-error-rollforward/3/new.json 2026-02-13T09:48:48.469 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCA845p7gfeDhAAnzI29HJcaU8vbhyEz+TiKw== --osd-uuid 2bd127f0-fe2c-4e12-9828-b794dc4ad475 2026-02-13T09:48:48.485 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:48.478+0000 7f49d3d6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:48.486 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:48.478+0000 7f49d3d6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:48.487 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:48.478+0000 7f49d3d6ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:48.488 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:48.478+0000 7f49d3d6ba40 -1 bdev(0x561f257d6c00 td/ec-error-rollforward/3/block) open stat got: (1) Operation not permitted 2026-02-13T09:48:48.488 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:48.478+0000 7f49d3d6ba40 -1 bluestore(td/ec-error-rollforward/3) _read_fsid unparsable uuid 2026-02-13T09:48:49.087 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/ec-error-rollforward/3/keyring 2026-02-13T09:48:49.087 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:48:49.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T09:48:49.088 INFO:tasks.workunit.client.0.trial010.stdout:adding osd3 key to auth repository 2026-02-13T09:48:49.088 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/ec-error-rollforward/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:48:49.380 INFO:tasks.workunit.client.0.trial010.stdout:start osd.3 2026-02-13T09:48:49.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T09:48:49.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:49.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:48:49.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:48:49.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:48:49.402 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:49.394+0000 7f7389231a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:49.404 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:49.394+0000 7f7389231a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:49.405 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:49.398+0000 7f7389231a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:49.597 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T09:48:49.597 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:49.597 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T09:48:49.597 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:49.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:49.598 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:49.598 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:49.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:49.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:49.599 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:48:49.762 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:49.754+0000 7f7389231a40 -1 Falling back to public interface 2026-02-13T09:48:49.809 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:48:50.390 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:50.382+0000 7f7389231a40 -1 osd.3 0 log_to_monitors true 2026-02-13T09:48:50.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:48:50.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:50.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:48:50.812 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:48:50.812 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:50.812 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:48:51.024 INFO:tasks.workunit.client.0.trial010.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3218398642,v1:127.0.0.1:6827/3218398642] [v2:127.0.0.1:6828/3218398642,v1:127.0.0.1:6829/3218398642] exists,up 2bd127f0-fe2c-4e12-9828-b794dc4ad475 2026-02-13T09:48:51.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:51.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:51.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:51.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:35: TEST_ec_error_rollforward: ceph osd erasure-code-profile set ec-profile m=2 k=2 crush-failure-domain=osd 2026-02-13T09:48:51.276 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:36: TEST_ec_error_rollforward: ceph osd pool create ec 1 1 erasure ec-profile 2026-02-13T09:48:51.647 INFO:tasks.workunit.client.0.trial010.stderr:pool 'ec' already exists 2026-02-13T09:48:51.658 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:38: TEST_ec_error_rollforward: rados -p ec put foo /etc/passwd 2026-02-13T09:48:52.218 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: cat td/ec-error-rollforward/osd.2.pid 2026-02-13T09:48:52.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:40: TEST_ec_error_rollforward: kill -STOP 76308 2026-02-13T09:48:52.219 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:43: TEST_ec_error_rollforward: pids=78741 2026-02-13T09:48:52.219 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:44: TEST_ec_error_rollforward: sleep 1 2026-02-13T09:48:52.219 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:42: TEST_ec_error_rollforward: rados -p ec rm foo 2026-02-13T09:48:53.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:46: TEST_ec_error_rollforward: pids+=' 78762' 2026-02-13T09:48:53.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:45: TEST_ec_error_rollforward: rados -p ec rm a 2026-02-13T09:48:53.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:48: TEST_ec_error_rollforward: pids+=' 78763' 2026-02-13T09:48:53.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:47: TEST_ec_error_rollforward: rados -p ec rm b 2026-02-13T09:48:53.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:50: TEST_ec_error_rollforward: pids+=' 78764' 2026-02-13T09:48:53.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:51: TEST_ec_error_rollforward: sleep 1 2026-02-13T09:48:53.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:49: TEST_ec_error_rollforward: rados -p ec rm c 2026-02-13T09:48:54.222 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:54: TEST_ec_error_rollforward: kill_daemons td/ec-error-rollforward KILL osd 2026-02-13T09:48:54.223 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:48:54.223 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:48:54.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:48:54.224 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:48:54.224 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:48:54.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:48:54.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:55: TEST_ec_error_rollforward: kill 78741 78762 78763 78764 2026-02-13T09:48:54.334 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:56: TEST_ec_error_rollforward: wait 2026-02-13T09:48:54.338 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:58: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 0 2026-02-13T09:48:54.338 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:54.338 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/0 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/0' 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/0/journal' 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:54.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:54.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/0 2026-02-13T09:48:54.341 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:48:54.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:48:54.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/0 --osd-journal=td/ec-error-rollforward/0/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:54.343 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/0/whoami 2026-02-13T09:48:54.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:48:54.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:48:54.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:48:54.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:48:54.360 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:54.350+0000 7f98869f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:54.362 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:54.354+0000 7f98869f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:54.363 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:54.354+0000 7f98869f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:54.554 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:48:54.554 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:54.554 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:48:54.554 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:54.554 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:54.554 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:54.555 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:54.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:54.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:54.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:48:54.767 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/3608428394,v1:127.0.0.1:6801/3608428394] [v2:127.0.0.1:6802/3608428394,v1:127.0.0.1:6803/3608428394] exists,up 7e117159-a579-4f47-94c9-a685d074e6b9 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:59: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 1 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:48:54.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/1 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/1' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/1/journal' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:54.771 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:54.772 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:54.773 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:48:54.773 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:48:54.773 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/1 2026-02-13T09:48:54.773 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:48:54.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:48:54.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/1 --osd-journal=td/ec-error-rollforward/1/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:54.774 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/1/whoami 2026-02-13T09:48:54.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:48:54.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:48:54.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:48:54.775 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:48:54.784 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:54.774+0000 7ff2ac832a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:54.786 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:54.778+0000 7ff2ac832a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:54.786 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:54.778+0000 7ff2ac832a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:54.854 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:54.846+0000 7f98869f0a40 -1 Falling back to public interface 2026-02-13T09:48:54.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:48:54.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:54.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:48:54.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:54.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:54.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:54.984 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:54.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:54.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:54.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:48:55.190 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 21 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1775501216,v1:127.0.0.1:6811/1775501216] [v2:127.0.0.1:6812/1775501216,v1:127.0.0.1:6813/1775501216] exists,up ebaba7e7-eaed-4566-8e7a-600e3a6e47c1 2026-02-13T09:48:55.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:55.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:55.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:55.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:60: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 2 2026-02-13T09:48:55.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:55.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:48:55.193 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/2 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/2' 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/2/journal' 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:48:55.194 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:55.195 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:55.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:55.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:55.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:48:55.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:48:55.196 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/2 2026-02-13T09:48:55.196 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:48:55.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:48:55.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/2 --osd-journal=td/ec-error-rollforward/2/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:55.197 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/2/whoami 2026-02-13T09:48:55.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:48:55.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:48:55.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:48:55.198 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:48:55.211 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.202+0000 7f4f80f78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:55.212 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.202+0000 7f4f80f78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:55.213 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.206+0000 7f4f80f78a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:55.322 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.314+0000 7ff2ac832a40 -1 Falling back to public interface 2026-02-13T09:48:55.412 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:48:55.412 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:55.412 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:48:55.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:55.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:55.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:55.413 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:55.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:55.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:55.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:48:55.615 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/945798717,v1:127.0.0.1:6819/945798717] [v2:127.0.0.1:6820/945798717,v1:127.0.0.1:6821/945798717] exists,up a3557d6e-e184-41dc-a7c1-73f1018fdb62 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:61: TEST_ec_error_rollforward: activate_osd td/ec-error-rollforward 3 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/ec-error-rollforward 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/ec-error-rollforward/3 2026-02-13T09:48:55.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 ' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/ec-error-rollforward/3' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/ec-error-rollforward/3/journal' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/ec-error-rollforward' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:48:55.620 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/ec-error-rollforward/$name.log' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/ec-error-rollforward/$name.pid' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:48:55.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:48:55.622 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/ec-error-rollforward/3 2026-02-13T09:48:55.622 INFO:tasks.workunit.client.0.trial010.stdout:start osd.3 2026-02-13T09:48:55.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T09:48:55.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=1772d7f3-0d9f-4b23-a0dc-c779c60eefba --auth-supported=none --mon-host=127.0.0.1:7132 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/ec-error-rollforward/3 --osd-journal=td/ec-error-rollforward/3/journal --chdir= --run-dir=td/ec-error-rollforward '--admin-socket=/tmp/ceph-asok.71690/$cluster-$name.asok' --debug-osd=20 '--log-file=td/ec-error-rollforward/$name.log' '--pid-file=td/ec-error-rollforward/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:48:55.623 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/ec-error-rollforward/3/whoami 2026-02-13T09:48:55.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T09:48:55.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:48:55.623 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:48:55.624 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:48:55.635 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.626+0000 7f397c164a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:55.637 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.630+0000 7f397c164a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:55.637 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.630+0000 7f397c164a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:48:55.690 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.682+0000 7f4f80f78a40 -1 Falling back to public interface 2026-02-13T09:48:55.831 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T09:48:55.831 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:48:55.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T09:48:55.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:48:55.832 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:48:55.832 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:48:55.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:48:55.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:48:55.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:48:55.833 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:48:55.839 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:55.830+0000 7f98869f0a40 -1 osd.0 23 log_to_monitors true 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stdout:osd.3 up in weight 1 up_from 18 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/3218398642,v1:127.0.0.1:6827/3218398642] [v2:127.0.0.1:6828/3218398642,v1:127.0.0.1:6829/3218398642] exists,up 2bd127f0-fe2c-4e12-9828-b794dc4ad475 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:63: TEST_ec_error_rollforward: wait_for_clean 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:48:56.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:48:56.041 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:48:56.041 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:48:56.041 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:48:56.041 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:48:56.041 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:48:56.041 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:48:56.140 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:48:56.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:48:56.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:48:56.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:48:56.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:48:56.141 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:48:56.146 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:56.138+0000 7f397c164a40 -1 Falling back to public interface 2026-02-13T09:48:56.353 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:48:56.353 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:48:56.353 INFO:tasks.workunit.client.0.trial010.stderr:2 2026-02-13T09:48:56.353 INFO:tasks.workunit.client.0.trial010.stderr:3' 2026-02-13T09:48:56.353 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:48:56.353 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:48:56.354 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:48:56.366 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:56.358+0000 7ff2ac832a40 -1 osd.1 23 log_to_monitors true 2026-02-13T09:48:56.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=111669149699 2026-02-13T09:48:56.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 111669149699 2026-02-13T09:48:56.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-111669149699' 2026-02-13T09:48:56.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:48:56.432 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:48:56.696 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:56.686+0000 7f4f80f78a40 -1 osd.2 22 log_to_monitors true 2026-02-13T09:48:57.027 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:48:57.018+0000 7f397c164a40 -1 osd.3 23 log_to_monitors true 2026-02-13T09:49:01.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=128849018884 2026-02-13T09:49:01.518 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 128849018884 2026-02-13T09:49:01.518 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-111669149699 1-128849018884' 2026-02-13T09:49:01.518 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:49:01.518 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:49:01.596 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=146028888067 2026-02-13T09:49:01.596 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 146028888067 2026-02-13T09:49:01.597 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-111669149699 1-128849018884 2-146028888067' 2026-02-13T09:49:01.597 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:49:01.597 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T09:49:01.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=154618822659 2026-02-13T09:49:01.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 154618822659 2026-02-13T09:49:01.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-111669149699 1-128849018884 2-146028888067 3-154618822659' 2026-02-13T09:49:01.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:49:01.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-111669149699 2026-02-13T09:49:01.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:49:01.674 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:49:01.675 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-111669149699 2026-02-13T09:49:01.675 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:49:01.677 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=111669149699 2026-02-13T09:49:01.677 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 111669149699' 2026-02-13T09:49:01.677 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 111669149699 2026-02-13T09:49:01.677 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:49:01.892 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 111669149700 -lt 111669149699 2026-02-13T09:49:01.892 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:49:01.893 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-128849018884 2026-02-13T09:49:01.893 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:49:01.894 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:49:01.895 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-128849018884 2026-02-13T09:49:01.895 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:49:01.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=128849018884 2026-02-13T09:49:01.896 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 128849018884 2026-02-13T09:49:01.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 128849018884' 2026-02-13T09:49:01.897 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:49:02.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 128849018884 2026-02-13T09:49:02.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:49:03.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:49:03.125 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:49:03.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 128849018884 -lt 128849018884 2026-02-13T09:49:03.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:49:03.331 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-146028888067 2026-02-13T09:49:03.332 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:49:03.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:49:03.334 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-146028888067 2026-02-13T09:49:03.334 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:49:03.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=146028888067 2026-02-13T09:49:03.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 146028888067' 2026-02-13T09:49:03.335 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 146028888067 2026-02-13T09:49:03.336 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:49:03.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 146028888068 -lt 146028888067 2026-02-13T09:49:03.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:49:03.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-154618822659 2026-02-13T09:49:03.560 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:49:03.560 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T09:49:03.561 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-154618822659 2026-02-13T09:49:03.562 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:49:03.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=154618822659 2026-02-13T09:49:03.563 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.3 seq 154618822659 2026-02-13T09:49:03.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 154618822659' 2026-02-13T09:49:03.564 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T09:49:03.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 154618822660 -lt 154618822659 2026-02-13T09:49:03.787 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:49:03.788 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:49:03.788 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:49:04.065 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 1 == 0 2026-02-13T09:49:04.066 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:49:04.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:49:04.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:49:04.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:49:04.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:49:04.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:49:04.067 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:49:04.278 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=1 2026-02-13T09:49:04.279 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:49:04.279 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:49:04.279 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 1 = 1 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/ec-error-rollforward.sh:22: run: teardown td/ec-error-rollforward 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-13T09:49:04.558 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:49:04.559 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:49:04.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:49:04.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:49:04.559 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:49:04.668 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:49:04.668 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:49:04.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:49:04.669 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:49:04.671 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:49:04.671 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:49:04.671 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:49:04.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:04.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:49:04.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:49:04.673 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:04.674 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:49:04.675 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:49:04.675 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-13T09:49:04.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:49:04.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:04.686 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:49:04.686 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.71690 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/ec-error-rollforward 0 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/ec-error-rollforward 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/ec-error-rollforward KILL 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:49:04.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:49:04.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:49:04.691 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:49:04.691 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:49:04.692 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:49:04.692 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:49:04.693 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:49:04.693 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:49:04.693 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:49:04.694 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:04.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:49:04.695 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:49:04.695 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:04.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:49:04.697 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T09:49:04.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/ec-error-rollforward 2026-02-13T09:49:04.699 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:49:04.699 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:04.699 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.71690 2026-02-13T09:49:04.699 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.71690 2026-02-13T09:49:04.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:49:04.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:49:04.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-13T09:49:04.701 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T09:49:04.701 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T09:49:04.753 INFO:tasks.workunit:Running workunit osd/osd-bench.sh... 2026-02-13T09:49:04.753 DEBUG:teuthology.orchestra.run.trial010:workunit test osd/osd-bench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh 2026-02-13T09:49:04.806 INFO:tasks.workunit.client.0.trial010.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T09:49:04.809 INFO:tasks.workunit.client.0.trial010.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T09:49:04.809 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/osd-bench 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:22: run: local dir=td/osd-bench 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:23: run: shift 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: export CEPH_MON=127.0.0.1:7106 2026-02-13T09:49:04.810 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:25: run: CEPH_MON=127.0.0.1:7106 2026-02-13T09:49:04.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:26: run: export CEPH_ARGS 2026-02-13T09:49:04.811 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: uuidgen 2026-02-13T09:49:04.812 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:27: run: CEPH_ARGS+='--fsid=4cf89440-047f-4c2c-8cf2-ba9cb8d69c9b --auth-supported=none ' 2026-02-13T09:49:04.812 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:28: run: CEPH_ARGS+='--mon-host=127.0.0.1:7106 ' 2026-02-13T09:49:04.812 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:29: run: CEPH_ARGS+='--debug-bluestore 20 ' 2026-02-13T09:49:04.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: set 2026-02-13T09:49:04.812 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:31: run: local funcs=TEST_bench 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:32: run: for func in $funcs 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:33: run: setup td/osd-bench 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bench 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bench 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:49:04.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:49:04.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:49:04.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:49:04.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:49:04.815 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:49:04.816 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:49:04.816 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:49:04.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:49:04.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:49:04.817 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:49:04.818 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:04.818 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:49:04.819 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:49:04.819 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:04.820 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:49:04.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:49:04.821 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-13T09:49:04.823 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:49:04.823 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:04.823 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:04.823 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.81374 2026-02-13T09:49:04.824 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:49:04.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:49:04.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bench 2026-02-13T09:49:04.825 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:49:04.826 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:04.826 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:04.826 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.81374 2026-02-13T09:49:04.827 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:49:04.828 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bench 1' TERM HUP INT 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:34: run: TEST_bench td/osd-bench 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:40: TEST_bench: local dir=td/osd-bench 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:42: TEST_bench: run_mon td/osd-bench a 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bench 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bench/a 2026-02-13T09:49:04.829 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bench/a --run-dir=td/osd-bench 2026-02-13T09:49:04.852 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:49:04.852 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:04.852 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:04.852 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:04.852 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:04.852 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:04.853 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.81374/$cluster-$name.asok' 2026-02-13T09:49:04.853 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bench/a '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.81374/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bench/log --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:49:04.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:49:04.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:49:04.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:49:04.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:49:04.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:49:04.882 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.81374/ceph-mon.a.asok 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:49:04.884 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.81374/ceph-mon.a.asok config get fsid 2026-02-13T09:49:04.940 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:49:04.940 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:49:04.940 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:49:04.940 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:49:04.940 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:49:04.941 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.81374/ceph-mon.a.asok 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:49:04.942 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.81374/ceph-mon.a.asok config get mon_host 2026-02-13T09:49:04.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:43: TEST_bench: run_mgr td/osd-bench x 2026-02-13T09:49:04.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bench 2026-02-13T09:49:04.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:49:04.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:49:04.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:49:04.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bench/x 2026-02-13T09:49:04.996 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:49:05.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:49:05.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:05.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:05.109 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:05.109 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:05.109 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:05.109 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.81374/$cluster-$name.asok' 2026-02-13T09:49:05.110 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:49:05.111 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bench/x '--log-file=td/osd-bench/$name.log' '--admin-socket=/tmp/ceph-asok.81374/$cluster-$name.asok' --run-dir=td/osd-bench '--pid-file=td/osd-bench/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:44: TEST_bench: run_osd td/osd-bench 0 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bench 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bench/0 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=4cf89440-047f-4c2c-8cf2-ba9cb8d69c9b --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 ' 2026-02-13T09:49:05.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bench/0' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bench/0/journal' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bench' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:05.131 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.81374/$cluster-$name.asok' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.81374/$cluster-$name.asok' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bench/$name.log' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bench/$name.pid' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:49:05.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:49:05.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:49:05.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bench/0 2026-02-13T09:49:05.133 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:49:05.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=79ec9ff7-337f-4e3a-b54c-c51d9c51fc67 2026-02-13T09:49:05.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 79ec9ff7-337f-4e3a-b54c-c51d9c51fc67' 2026-02-13T09:49:05.134 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 79ec9ff7-337f-4e3a-b54c-c51d9c51fc67 2026-02-13T09:49:05.134 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:49:05.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCR845pLT84CBAATvR6dqdbw1a1PSJxiwR08w== 2026-02-13T09:49:05.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCR845pLT84CBAATvR6dqdbw1a1PSJxiwR08w=="}' 2026-02-13T09:49:05.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 79ec9ff7-337f-4e3a-b54c-c51d9c51fc67 -i td/osd-bench/0/new.json 2026-02-13T09:49:05.256 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:49:05.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bench/0/new.json 2026-02-13T09:49:05.266 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=4cf89440-047f-4c2c-8cf2-ba9cb8d69c9b --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.81374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCR845pLT84CBAATvR6dqdbw1a1PSJxiwR08w== --osd-uuid 79ec9ff7-337f-4e3a-b54c-c51d9c51fc67 2026-02-13T09:49:05.282 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:05.273+0000 7f74b803ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:05.283 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:05.273+0000 7f74b803ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:05.284 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:05.273+0000 7f74b803ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:05.285 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:05.277+0000 7f74b803ca40 -1 bdev(0x55f674342c00 td/osd-bench/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:49:05.285 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:05.277+0000 7f74b803ca40 -1 bluestore(td/osd-bench/0) _read_fsid unparsable uuid 2026-02-13T09:49:06.076 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bench/0/keyring 2026-02-13T09:49:06.077 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:49:06.077 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:49:06.078 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:49:06.078 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bench/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:49:06.197 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:49:06.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:49:06.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=4cf89440-047f-4c2c-8cf2-ba9cb8d69c9b --auth-supported=none --mon-host=127.0.0.1:7106 --debug-bluestore 20 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bench/0 --osd-journal=td/osd-bench/0/journal --chdir= --run-dir=td/osd-bench '--admin-socket=/tmp/ceph-asok.81374/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bench/$name.log' '--pid-file=td/osd-bench/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:49:06.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:49:06.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:49:06.197 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:49:06.219 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:06.209+0000 7fb01b1d3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:06.221 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:06.213+0000 7fb01b1d3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:06.222 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:06.213+0000 7fb01b1d3a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:06.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:49:06.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:49:06.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:49:06.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:49:06.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:49:06.306 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:06.307 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:49:06.307 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:49:06.307 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:06.308 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:49:06.411 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:06.586 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:06.577+0000 7fb01b1d3a40 -1 Falling back to public interface 2026-02-13T09:49:07.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:07.413 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:07.413 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:49:07.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:49:07.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:07.414 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:49:07.482 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:07.473+0000 7fb01b1d3a40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:49:07.618 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:08.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:08.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:08.621 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:49:08.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:49:08.622 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:08.622 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:49:08.826 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6800/4066184554,v1:127.0.0.1:6801/4066184554] [v2:127.0.0.1:6802/4066184554,v1:127.0.0.1:6803/4066184554] exists,up 79ec9ff7-337f-4e3a-b54c-c51d9c51fc67 2026-02-13T09:49:08.826 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:49:08.826 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:49:08.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:49:08.827 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: CEPH_ARGS= 2026-02-13T09:49:08.827 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: ceph-conf --show-config-value osd_bench_small_size_max_iops 2026-02-13T09:49:08.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:47: TEST_bench: local osd_bench_small_size_max_iops=100 2026-02-13T09:49:08.835 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: CEPH_ARGS= 2026-02-13T09:49:08.836 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: ceph-conf --show-config-value osd_bench_large_size_max_throughput 2026-02-13T09:49:08.849 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:49: TEST_bench: local osd_bench_large_size_max_throughput=104857600 2026-02-13T09:49:08.850 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: CEPH_ARGS= 2026-02-13T09:49:08.850 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: ceph-conf --show-config-value osd_bench_max_block_size 2026-02-13T09:49:08.862 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:51: TEST_bench: local osd_bench_max_block_size=67108864 2026-02-13T09:49:08.862 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: CEPH_ARGS= 2026-02-13T09:49:08.862 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: ceph-conf --show-config-value osd_bench_duration 2026-02-13T09:49:08.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:53: TEST_bench: local osd_bench_duration=30 2026-02-13T09:49:08.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:58: TEST_bench: expect_failure td/osd-bench osd_bench_max_block_size ceph tell osd.0 bench 1024 67108865 2026-02-13T09:49:08.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-13T09:49:08.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-13T09:49:08.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_max_block_size 2026-02-13T09:49:08.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-13T09:49:08.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-13T09:49:08.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 1024 67108865 2026-02-13T09:49:08.946 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-13T09:49:08.946 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-13T09:49:08.946 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_max_block_size td/osd-bench/out 2026-02-13T09:49:08.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-13T09:49:08.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:64: TEST_bench: local bsize=1024 2026-02-13T09:49:08.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:65: TEST_bench: local max_count=3072000 2026-02-13T09:49:08.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:66: TEST_bench: expect_failure td/osd-bench bench_small_size_max_iops ceph tell osd.0 bench 3072001 1024 2026-02-13T09:49:08.948 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-13T09:49:08.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-13T09:49:08.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=bench_small_size_max_iops 2026-02-13T09:49:08.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-13T09:49:08.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-13T09:49:08.949 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3072001 1024 2026-02-13T09:49:09.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-13T09:49:09.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-13T09:49:09.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet bench_small_size_max_iops td/osd-bench/out 2026-02-13T09:49:09.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-13T09:49:09.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:72: TEST_bench: local bsize=1048577 2026-02-13T09:49:09.020 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:73: TEST_bench: local max_count=3145728000 2026-02-13T09:49:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:74: TEST_bench: expect_failure td/osd-bench osd_bench_large_size_max_throughput ceph tell osd.0 bench 3145728001 1048577 2026-02-13T09:49:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2016: expect_failure: local dir=td/osd-bench 2026-02-13T09:49:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2017: expect_failure: shift 2026-02-13T09:49:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2018: expect_failure: local expected=osd_bench_large_size_max_throughput 2026-02-13T09:49:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2019: expect_failure: shift 2026-02-13T09:49:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2020: expect_failure: local success 2026-02-13T09:49:09.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2022: expect_failure: ceph tell osd.0 bench 3145728001 1048577 2026-02-13T09:49:09.089 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2025: expect_failure: success=false 2026-02-13T09:49:09.089 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: false 2026-02-13T09:49:09.089 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2028: expect_failure: grep --quiet osd_bench_large_size_max_throughput td/osd-bench/out 2026-02-13T09:49:09.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2032: expect_failure: return 0 2026-02-13T09:49:09.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:80: TEST_bench: ceph tell osd.0 bench 2026-02-13T09:49:10.695 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:49:10.695 INFO:tasks.workunit.client.0.trial010.stdout: "bytes_written": 1073741824, 2026-02-13T09:49:10.695 INFO:tasks.workunit.client.0.trial010.stdout: "blocksize": 4194304, 2026-02-13T09:49:10.695 INFO:tasks.workunit.client.0.trial010.stdout: "elapsed_sec": 0.70829243200000003, 2026-02-13T09:49:10.695 INFO:tasks.workunit.client.0.trial010.stdout: "bytes_per_sec": 1515958346.4249127, 2026-02-13T09:49:10.695 INFO:tasks.workunit.client.0.trial010.stdout: "iops": 361.43263493178193 2026-02-13T09:49:10.695 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:49:10.707 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:84: TEST_bench: ceph tell osd.0 bench 10 14456 4444 3 2026-02-13T09:49:10.779 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:49:10.779 INFO:tasks.workunit.client.0.trial010.stdout: "bytes_written": 10, 2026-02-13T09:49:10.779 INFO:tasks.workunit.client.0.trial010.stdout: "blocksize": 14456, 2026-02-13T09:49:10.780 INFO:tasks.workunit.client.0.trial010.stdout: "elapsed_sec": 0.00031580600000000002, 2026-02-13T09:49:10.780 INFO:tasks.workunit.client.0.trial010.stdout: "bytes_per_sec": 31665.009531167867, 2026-02-13T09:49:10.780 INFO:tasks.workunit.client.0.trial010.stdout: "iops": 2.1904406150503504 2026-02-13T09:49:10.780 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:49:10.789 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:90: TEST_bench: ceph tell osd.0 bench 1 14456 2026-02-13T09:49:10.855 INFO:tasks.workunit.client.0.trial010.stdout:{ 2026-02-13T09:49:10.855 INFO:tasks.workunit.client.0.trial010.stdout: "bytes_written": 1, 2026-02-13T09:49:10.855 INFO:tasks.workunit.client.0.trial010.stdout: "blocksize": 14456, 2026-02-13T09:49:10.855 INFO:tasks.workunit.client.0.trial010.stdout: "elapsed_sec": 0.00017941300000000001, 2026-02-13T09:49:10.855 INFO:tasks.workunit.client.0.trial010.stdout: "bytes_per_sec": 5573.7321152870745, 2026-02-13T09:49:10.855 INFO:tasks.workunit.client.0.trial010.stdout: "iops": 0.38556530957990276 2026-02-13T09:49:10.855 INFO:tasks.workunit.client.0.trial010.stdout:} 2026-02-13T09:49:10.862 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bench.sh:35: run: teardown td/osd-bench 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:49:10.863 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:49:10.971 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:49:10.971 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:49:10.972 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:49:10.972 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:49:10.973 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:49:10.973 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:49:10.974 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:49:10.975 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:10.975 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:49:10.975 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:49:10.976 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:10.977 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:49:10.978 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:49:10.978 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-13T09:49:11.012 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:49:11.013 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.013 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:11.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.81374 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2401: main: code=0 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/osd-bench 0 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bench 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=0 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bench KILL 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:49:11.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:49:11.017 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:49:11.017 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:49:11.018 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:49:11.018 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:49:11.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:49:11.019 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:49:11.020 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:49:11.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:11.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:49:11.021 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:49:11.021 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:11.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:49:11.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 0 = 1 ']' 2026-02-13T09:49:11.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bench 2026-02-13T09:49:11.025 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:49:11.025 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.025 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.81374 2026-02-13T09:49:11.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.81374 2026-02-13T09:49:11.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:49:11.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:49:11.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 0 2026-02-13T09:49:11.027 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-13T09:49:11.028 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T09:49:11.076 INFO:tasks.workunit:Running workunit osd/osd-bluefs-volume-ops.sh... 2026-02-13T09:49:11.076 DEBUG:teuthology.orchestra.run.trial010:workunit test osd/osd-bluefs-volume-ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh 2026-02-13T09:49:11.125 INFO:tasks.workunit.client.0.trial010.stderr:stty: 'standard input': Inappropriate ioctl for device 2026-02-13T09:49:11.129 INFO:tasks.workunit.client.0.trial010.stderr:+ PS4='${BASH_SOURCE[0]}:$LINENO: ${FUNCNAME[0]}: ' 2026-02-13T09:49:11.129 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: export PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:49:11.129 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2394: main: PATH=.:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2026-02-13T09:49:11.129 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: export PYTHONWARNINGS=ignore 2026-02-13T09:49:11.129 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2395: main: PYTHONWARNINGS=ignore 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: export CEPH_CONF=/dev/null 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2396: main: CEPH_CONF=/dev/null 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2397: main: unset CEPH_ARGS 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2399: main: local code 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2400: main: run td/osd-bluefs-volume-ops 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:8: run: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:9: run: shift 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: set 2026-02-13T09:49:11.130 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: sed -n -e 's/^\(TEST_[0-9a-z_]*\) .*/\1/p' 2026-02-13T09:49:11.132 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:11: run: local 'funcs=TEST_bluestore 2026-02-13T09:49:11.132 INFO:tasks.workunit.client.0.trial010.stderr:TEST_bluestore2 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:TEST_bluestore_expand' 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:49:11.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:49:11.135 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:49:11.136 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:49:11.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:49:11.137 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:49:11.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:49:11.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:49:11.138 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:49:11.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:11.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:49:11.140 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:49:11.140 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:49:11.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:49:11.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:49:11.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T09:49:11.144 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:49:11.144 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.144 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:11.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83516 2026-02-13T09:49:11.145 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:49:11.145 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:49:11.145 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-13T09:49:11.147 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:49:11.147 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.147 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:11.147 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83516 2026-02-13T09:49:11.149 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:49:11.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 1024 -le 1024 ']' 2026-02-13T09:49:11.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:127: setup: ulimit -n 4096 2026-02-13T09:49:11.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:49:11.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-13T09:49:11.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore td/osd-bluefs-volume-ops 2026-02-13T09:49:11.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:20: TEST_bluestore: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.150 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: ulimit -n 2026-02-13T09:49:11.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:22: TEST_bluestore: local flimit=4096 2026-02-13T09:49:11.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:23: TEST_bluestore: '[' 4096 -lt 1536 ']' 2026-02-13T09:49:11.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: export CEPH_MON=127.0.0.1:7146 2026-02-13T09:49:11.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:26: TEST_bluestore: CEPH_MON=127.0.0.1:7146 2026-02-13T09:49:11.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:27: TEST_bluestore: export CEPH_ARGS 2026-02-13T09:49:11.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: uuidgen 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:28: TEST_bluestore: CEPH_ARGS+='--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:29: TEST_bluestore: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:30: TEST_bluestore: CEPH_ARGS+='--bluestore_block_size=2147483648 ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:31: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:32: TEST_bluestore: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:33: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_size=536870912 ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:34: TEST_bluestore: CEPH_ARGS+='--bluestore_block_wal_create=true ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:35: TEST_bluestore: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:37: TEST_bluestore: CEPH_ARGS+='--bluestore_allocation_from_file=1 ' 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:39: TEST_bluestore: run_mon td/osd-bluefs-volume-ops a 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:49:11.152 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:49:11.153 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:49:11.153 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-13T09:49:11.153 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:49:11.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:11.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:11.176 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:11.176 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.176 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:11.176 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:11.177 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:49:11.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:49:11.205 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:49:11.205 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:49:11.205 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:49:11.205 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:11.206 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83516/ceph-mon.a.asok 2026-02-13T09:49:11.207 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:49:11.207 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83516/ceph-mon.a.asok config get fsid 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:49:11.261 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:49:11.262 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:49:11.262 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.262 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:11.262 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83516/ceph-mon.a.asok 2026-02-13T09:49:11.262 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:49:11.262 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83516/ceph-mon.a.asok config get mon_host 2026-02-13T09:49:11.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:40: TEST_bluestore: run_mgr td/osd-bluefs-volume-ops x 2026-02-13T09:49:11.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:49:11.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:49:11.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:49:11.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-13T09:49:11.315 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:49:11.422 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:49:11.422 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:11.422 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:11.422 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:11.422 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.422 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:11.422 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:11.423 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:49:11.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:41: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 0 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:11.444 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:49:11.445 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:49:11.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:49:11.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:49:11.446 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T09:49:11.447 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:49:11.448 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=71b8264e-ce14-4228-918f-0e2a243090b0 2026-02-13T09:49:11.448 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 71b8264e-ce14-4228-918f-0e2a243090b0' 2026-02-13T09:49:11.448 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 71b8264e-ce14-4228-918f-0e2a243090b0 2026-02-13T09:49:11.449 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:49:11.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCX845pTCkgGxAAE+YwA4tpVBrdeXmees8nUg== 2026-02-13T09:49:11.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCX845pTCkgGxAAE+YwA4tpVBrdeXmees8nUg=="}' 2026-02-13T09:49:11.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 71b8264e-ce14-4228-918f-0e2a243090b0 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-13T09:49:11.572 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:49:11.580 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-13T09:49:11.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCX845pTCkgGxAAE+YwA4tpVBrdeXmees8nUg== --osd-uuid 71b8264e-ce14-4228-918f-0e2a243090b0 2026-02-13T09:49:11.598 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:11.589+0000 7f2d83cada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:11.600 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:11.589+0000 7f2d83cada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:11.601 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:11.593+0000 7f2d83cada40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:11.602 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:11.593+0000 7f2d83cada40 -1 bdev(0x55e804d24c00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:49:11.602 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:11.593+0000 7f2d83cada40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-13T09:49:13.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-13T09:49:13.672 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:49:13.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:49:13.673 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:49:13.674 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:49:13.787 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:49:13.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:49:13.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:49:13.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:49:13.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:49:13.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:49:13.802 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:13.793+0000 7fb286da6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:13.803 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:13.793+0000 7fb286da6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:13.804 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:13.793+0000 7fb286da6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:14.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:49:14.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:49:14.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:49:14.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:49:14.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:49:14.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:14.002 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:49:14.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:49:14.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:14.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:49:14.216 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:14.306 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:14.297+0000 7fb286da6a40 -1 Falling back to public interface 2026-02-13T09:49:15.217 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:15.217 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:15.218 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:49:15.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:49:15.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:15.219 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:49:15.393 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:15.385+0000 7fb286da6a40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:49:15.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:16.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:16.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:16.442 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:49:16.443 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:49:16.443 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:16.443 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:49:16.650 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3394542793,v1:127.0.0.1:6803/3394542793] [v2:127.0.0.1:6804/3394542793,v1:127.0.0.1:6805/3394542793] exists,up 71b8264e-ce14-4228-918f-0e2a243090b0 2026-02-13T09:49:16.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:49:16.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:49:16.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:49:16.651 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:42: TEST_bluestore: osd_pid0=84992 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:43: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 1 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=1 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-13T09:49:16.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:16.655 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:49:16.656 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:49:16.657 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:49:16.657 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:49:16.657 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-13T09:49:16.657 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:49:16.657 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=b78903d7-70b5-4186-af4b-1ce1b75cce4e 2026-02-13T09:49:16.658 INFO:tasks.workunit.client.0.trial010.stdout:add osd1 b78903d7-70b5-4186-af4b-1ce1b75cce4e 2026-02-13T09:49:16.658 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd1 b78903d7-70b5-4186-af4b-1ce1b75cce4e' 2026-02-13T09:49:16.658 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:49:16.666 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCc845pFtF5JxAA5dN+NK3kFlkn2E3zqBkLhw== 2026-02-13T09:49:16.666 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCc845pFtF5JxAA5dN+NK3kFlkn2E3zqBkLhw=="}' 2026-02-13T09:49:16.666 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new b78903d7-70b5-4186-af4b-1ce1b75cce4e -i td/osd-bluefs-volume-ops/1/new.json 2026-02-13T09:49:16.893 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:49:16.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/1/new.json 2026-02-13T09:49:16.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 1 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCc845pFtF5JxAA5dN+NK3kFlkn2E3zqBkLhw== --osd-uuid b78903d7-70b5-4186-af4b-1ce1b75cce4e 2026-02-13T09:49:16.920 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:16.909+0000 7f8cea072a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:16.922 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:16.913+0000 7f8cea072a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:16.923 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:16.913+0000 7f8cea072a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:16.923 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:16.913+0000 7f8cea072a40 -1 bdev(0x55b8e057ec00 td/osd-bluefs-volume-ops/1/block) open stat got: (1) Operation not permitted 2026-02-13T09:49:16.923 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:16.913+0000 7f8cea072a40 -1 bluestore(td/osd-bluefs-volume-ops/1) _read_fsid unparsable uuid 2026-02-13T09:49:18.345 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/1/keyring 2026-02-13T09:49:18.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:49:18.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd1 key to auth repository 2026-02-13T09:49:18.347 INFO:tasks.workunit.client.0.trial010.stdout:adding osd1 key to auth repository 2026-02-13T09:49:18.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/1/keyring auth add osd.1 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:49:18.642 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:49:18.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.1 2026-02-13T09:49:18.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 1 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:49:18.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:49:18.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:49:18.642 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:49:18.664 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:18.653+0000 7f00994e0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:18.666 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:18.657+0000 7f00994e0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:18.667 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:18.657+0000 7f00994e0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:18.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 1 2026-02-13T09:49:18.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:49:18.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:49:18.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:49:18.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:49:18.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:18.858 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:49:18.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:49:18.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:18.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:49:19.072 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:19.222 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:19.213+0000 7f00994e0a40 -1 Falling back to public interface 2026-02-13T09:49:20.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:20.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:20.073 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:49:20.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:49:20.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:20.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:49:20.283 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:20.455 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:20.445+0000 7f00994e0a40 -1 osd.1 0 log_to_monitors true 2026-02-13T09:49:21.284 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:21.284 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:21.285 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:49:21.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:49:21.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:21.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:49:21.499 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 9 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6810/1029642278,v1:127.0.0.1:6811/1029642278] [v2:127.0.0.1:6812/1029642278,v1:127.0.0.1:6813/1029642278] exists,up b78903d7-70b5-4186-af4b-1ce1b75cce4e 2026-02-13T09:49:21.499 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:49:21.499 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:49:21.499 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:49:21.500 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:44: TEST_bluestore: osd_pid1=87175 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:45: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 2 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=2 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:49:21.501 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:49:21.502 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:49:21.502 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:21.502 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:21.502 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:21.502 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:21.502 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:21.502 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:49:21.503 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-13T09:49:21.504 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:49:21.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=db644d6a-4ae3-4873-aeb8-9ab9c85e655a 2026-02-13T09:49:21.505 INFO:tasks.workunit.client.0.trial010.stdout:add osd2 db644d6a-4ae3-4873-aeb8-9ab9c85e655a 2026-02-13T09:49:21.505 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd2 db644d6a-4ae3-4873-aeb8-9ab9c85e655a' 2026-02-13T09:49:21.506 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:49:21.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCh845pJaGaHhAAF3290FbS6knesoumvEB4zg== 2026-02-13T09:49:21.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCh845pJaGaHhAAF3290FbS6knesoumvEB4zg=="}' 2026-02-13T09:49:21.517 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new db644d6a-4ae3-4873-aeb8-9ab9c85e655a -i td/osd-bluefs-volume-ops/2/new.json 2026-02-13T09:49:21.726 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:49:21.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/2/new.json 2026-02-13T09:49:21.736 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 2 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCh845pJaGaHhAAF3290FbS6knesoumvEB4zg== --osd-uuid db644d6a-4ae3-4873-aeb8-9ab9c85e655a 2026-02-13T09:49:21.752 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:21.749+0000 7f720ba86a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:21.754 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:21.749+0000 7f720ba86a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:21.755 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:21.749+0000 7f720ba86a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:21.755 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:21.749+0000 7f720ba86a40 -1 bdev(0x5613a9e3ec00 td/osd-bluefs-volume-ops/2/block) open stat got: (1) Operation not permitted 2026-02-13T09:49:21.755 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:21.749+0000 7f720ba86a40 -1 bluestore(td/osd-bluefs-volume-ops/2) _read_fsid unparsable uuid 2026-02-13T09:49:23.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/2/keyring 2026-02-13T09:49:23.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:49:23.282 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd2 key to auth repository 2026-02-13T09:49:23.283 INFO:tasks.workunit.client.0.trial010.stdout:adding osd2 key to auth repository 2026-02-13T09:49:23.283 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/2/keyring auth add osd.2 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:49:23.573 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.2 2026-02-13T09:49:23.574 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:49:23.574 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 2 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:49:23.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:49:23.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:49:23.575 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:49:23.595 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:23.589+0000 7f3e2d780a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:23.597 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:23.593+0000 7f3e2d780a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:23.599 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:23.593+0000 7f3e2d780a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:23.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 2 2026-02-13T09:49:23.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:49:23.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:49:23.787 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:49:23.787 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:49:23.787 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:23.787 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:49:23.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:49:23.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:23.788 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:49:23.991 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:24.110 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:24.105+0000 7f3e2d780a40 -1 Falling back to public interface 2026-02-13T09:49:24.992 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:24.992 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:24.992 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:49:24.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:49:24.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:24.993 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:49:25.203 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:25.339 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:25.333+0000 7f3e2d780a40 -1 osd.2 0 log_to_monitors true 2026-02-13T09:49:26.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:26.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:26.205 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:49:26.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:49:26.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:26.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:49:26.420 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 14 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6818/3252558908,v1:127.0.0.1:6819/3252558908] [v2:127.0.0.1:6820/3252558908,v1:127.0.0.1:6821/3252558908] exists,up db644d6a-4ae3-4873-aeb8-9ab9c85e655a 2026-02-13T09:49:26.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:49:26.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:49:26.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:49:26.421 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-13T09:49:26.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:46: TEST_bluestore: osd_pid2=89322 2026-02-13T09:49:26.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:47: TEST_bluestore: run_osd td/osd-bluefs-volume-ops 3 2026-02-13T09:49:26.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:49:26.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:49:26.423 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=3 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:49:26.424 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:49:26.425 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:49:26.425 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:49:26.425 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:49:26.425 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:49:26.425 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:49:26.425 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:26.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:49:26.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:49:26.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:49:26.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:49:26.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:49:26.426 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-13T09:49:26.427 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:49:26.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=5bab6630-7079-401f-94c7-97f78bedcc3d 2026-02-13T09:49:26.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd3 5bab6630-7079-401f-94c7-97f78bedcc3d' 2026-02-13T09:49:26.428 INFO:tasks.workunit.client.0.trial010.stdout:add osd3 5bab6630-7079-401f-94c7-97f78bedcc3d 2026-02-13T09:49:26.428 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:49:26.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQCm845pUZjmGRAASqOam3qwkRlBqZCPWm4IFQ== 2026-02-13T09:49:26.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQCm845pUZjmGRAASqOam3qwkRlBqZCPWm4IFQ=="}' 2026-02-13T09:49:26.439 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new 5bab6630-7079-401f-94c7-97f78bedcc3d -i td/osd-bluefs-volume-ops/3/new.json 2026-02-13T09:49:26.657 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:49:26.666 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/3/new.json 2026-02-13T09:49:26.667 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 3 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQCm845pUZjmGRAASqOam3qwkRlBqZCPWm4IFQ== --osd-uuid 5bab6630-7079-401f-94c7-97f78bedcc3d 2026-02-13T09:49:26.681 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:26.677+0000 7fbc2fe72a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:26.683 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:26.677+0000 7fbc2fe72a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:26.684 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:26.677+0000 7fbc2fe72a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:26.685 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:26.681+0000 7fbc2fe72a40 -1 bdev(0x562be57a2c00 td/osd-bluefs-volume-ops/3/block) open stat got: (1) Operation not permitted 2026-02-13T09:49:26.685 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:26.681+0000 7fbc2fe72a40 -1 bluestore(td/osd-bluefs-volume-ops/3) _read_fsid unparsable uuid 2026-02-13T09:49:28.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/3/keyring 2026-02-13T09:49:28.100 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:49:28.100 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd3 key to auth repository 2026-02-13T09:49:28.101 INFO:tasks.workunit.client.0.trial010.stdout:adding osd3 key to auth repository 2026-02-13T09:49:28.101 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/3/keyring auth add osd.3 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:49:28.395 INFO:tasks.workunit.client.0.trial010.stdout:start osd.3 2026-02-13T09:49:28.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.3 2026-02-13T09:49:28.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 3 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:49:28.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:49:28.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:49:28.396 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:49:28.417 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:28.413+0000 7f0baf1dda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:28.419 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:28.413+0000 7f0baf1dda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:28.420 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:28.413+0000 7f0baf1dda40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:49:28.613 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 3 2026-02-13T09:49:28.613 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:49:28.613 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T09:49:28.613 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:49:28.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:49:28.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:49:28.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:28.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:49:28.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:28.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:49:28.825 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:28.946 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:28.941+0000 7f0baf1dda40 -1 Falling back to public interface 2026-02-13T09:49:29.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:29.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:29.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:49:29.827 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:49:29.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:29.827 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:49:30.025 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:49:30.021+0000 7f0baf1dda40 -1 osd.3 0 log_to_monitors true 2026-02-13T09:49:30.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:49:31.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:49:31.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:49:31.040 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:49:31.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:49:31.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:49:31.040 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:49:31.253 INFO:tasks.workunit.client.0.trial010.stdout:osd.3 up in weight 1 up_from 19 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6826/478656743,v1:127.0.0.1:6827/478656743] [v2:127.0.0.1:6828/478656743,v1:127.0.0.1:6829/478656743] exists,up 5bab6630-7079-401f-94c7-97f78bedcc3d 2026-02-13T09:49:31.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:49:31.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:49:31.254 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:49:31.254 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-13T09:49:31.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:48: TEST_bluestore: osd_pid3=91473 2026-02-13T09:49:31.255 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:50: TEST_bluestore: sleep 5 2026-02-13T09:49:36.257 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:52: TEST_bluestore: create_pool foo 16 2026-02-13T09:49:36.257 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-13T09:49:36.511 INFO:tasks.workunit.client.0.trial010.stderr:pool 'foo' already exists 2026-02-13T09:49:36.520 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:49:37.521 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:55: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-13T09:49:37.543 INFO:tasks.workunit.client.0.trial010.stdout:hints = 1 2026-02-13T09:49:37.543 INFO:tasks.workunit.client.0.trial010.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-13T09:49:37.543 INFO:tasks.workunit.client.0.trial010.stdout:Object prefix: benchmark_data_trial010_92431 2026-02-13T09:49:37.543 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:49:37.543 INFO:tasks.workunit.client.0.trial010.stdout: 0 0 0 0 0 0 - 0 2026-02-13T09:49:38.543 INFO:tasks.workunit.client.0.trial010.stdout: 1 15 11014 10999 42.9614 42.9648 0.0016343 0.00145209 2026-02-13T09:49:39.543 INFO:tasks.workunit.client.0.trial010.stdout: 2 16 21996 21980 42.9263 42.8945 0.00133688 0.00145384 2026-02-13T09:49:40.543 INFO:tasks.workunit.client.0.trial010.stdout: 3 16 33078 33062 43.0459 43.2891 0.0014623 0.00145006 2026-02-13T09:49:41.543 INFO:tasks.workunit.client.0.trial010.stdout: 4 16 44143 44127 43.0892 43.2227 0.00106276 0.00144868 2026-02-13T09:49:42.543 INFO:tasks.workunit.client.0.trial010.stdout: 5 15 55228 55213 43.1316 43.3047 0.00129989 0.00144736 2026-02-13T09:49:43.543 INFO:tasks.workunit.client.0.trial010.stdout: 6 16 66277 66261 43.1351 43.1562 0.00114708 0.00144731 2026-02-13T09:49:44.543 INFO:tasks.workunit.client.0.trial010.stdout: 7 16 77434 77418 43.1985 43.582 0.00166641 0.00144517 2026-02-13T09:49:45.543 INFO:tasks.workunit.client.0.trial010.stdout: 8 15 84094 84079 41.0509 26.0195 0.00120866 0.0015209 2026-02-13T09:49:46.543 INFO:tasks.workunit.client.0.trial010.stdout: 9 16 95275 95259 41.3418 43.6719 0.00223264 0.00151021 2026-02-13T09:49:47.544 INFO:tasks.workunit.client.0.trial010.stdout: 10 16 106448 106432 41.5717 43.6445 0.00165121 0.00150185 2026-02-13T09:49:48.543 INFO:tasks.workunit.client.0.trial010.stdout: 11 16 117556 117540 41.7368 43.3906 0.000909308 0.00149592 2026-02-13T09:49:49.544 INFO:tasks.workunit.client.0.trial010.stdout: 12 15 128417 128402 41.7942 42.4297 0.00119951 0.00149387 2026-02-13T09:49:50.544 INFO:tasks.workunit.client.0.trial010.stdout: 13 16 135601 135585 40.7375 28.0586 0.115319 0.00152619 2026-02-13T09:49:51.544 INFO:tasks.workunit.client.0.trial010.stdout: 14 16 135791 135775 37.8807 0.742188 0.0799252 0.00164156 2026-02-13T09:49:52.544 INFO:tasks.workunit.client.0.trial010.stdout: 15 16 135938 135922 35.3936 0.574219 0.171984 0.00174732 2026-02-13T09:49:53.544 INFO:tasks.workunit.client.0.trial010.stdout: 16 16 144145 144129 35.185 32.0586 0.00188178 0.00177476 2026-02-13T09:49:54.544 INFO:tasks.workunit.client.0.trial010.stdout: 17 16 153735 153719 35.3187 37.4609 0.00185979 0.00176806 2026-02-13T09:49:55.544 INFO:tasks.workunit.client.0.trial010.stdout: 18 16 163241 163225 35.4194 37.1328 0.00182817 0.00176303 2026-02-13T09:49:56.544 INFO:tasks.workunit.client.0.trial010.stdout: 19 16 172648 172632 35.4891 36.7461 0.00143737 0.00175958 2026-02-13T09:49:57.544 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:49:57.540977+0000 min lat: 0.000475092 max lat: 0.253093 avg lat: 0.00175604 2026-02-13T09:49:57.545 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:49:57.545 INFO:tasks.workunit.client.0.trial010.stdout: 20 16 182099 182083 35.5604 36.918 0.00126647 0.00175604 2026-02-13T09:49:58.544 INFO:tasks.workunit.client.0.trial010.stdout: 21 16 185186 185170 34.4412 12.0586 0.0365411 0.00175615 2026-02-13T09:49:59.545 INFO:tasks.workunit.client.0.trial010.stdout: 22 16 185259 185243 32.8886 0.285156 0.165146 0.00188862 2026-02-13T09:50:00.545 INFO:tasks.workunit.client.0.trial010.stdout: 23 16 191656 191640 32.5451 24.9883 0.00138839 0.00191885 2026-02-13T09:50:01.545 INFO:tasks.workunit.client.0.trial010.stdout: 24 16 200869 200853 32.6884 35.9883 0.00158306 0.00191046 2026-02-13T09:50:02.545 INFO:tasks.workunit.client.0.trial010.stdout: 25 16 210328 210312 32.8587 36.9492 0.00115545 0.00190055 2026-02-13T09:50:03.545 INFO:tasks.workunit.client.0.trial010.stdout: 26 16 219712 219696 33.0047 36.6562 0.00160639 0.0018921 2026-02-13T09:50:04.545 INFO:tasks.workunit.client.0.trial010.stdout: 27 16 229186 229170 33.1529 37.0078 0.00250487 0.00188368 2026-02-13T09:50:05.545 INFO:tasks.workunit.client.0.trial010.stdout: 28 16 238542 238526 33.274 36.5469 0.00140282 0.00187681 2026-02-13T09:50:06.545 INFO:tasks.workunit.client.0.trial010.stdout: 29 16 247911 247895 33.3885 36.5977 0.00164227 0.00187037 2026-02-13T09:50:07.545 INFO:tasks.workunit.client.0.trial010.stdout:Total time run: 30.0014 2026-02-13T09:50:07.545 INFO:tasks.workunit.client.0.trial010.stdout:Total writes made: 257253 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Write size: 4096 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Object size: 4096 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Bandwidth (MB/sec): 33.4949 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Bandwidth: 13.4076 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Max bandwidth (MB/sec): 43.6719 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Min bandwidth (MB/sec): 0.285156 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Average IOPS: 8574 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Stddev IOPS: 3432.35 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Max IOPS: 11180 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Min IOPS: 73 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Average Latency(s): 0.00186445 2026-02-13T09:50:07.546 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Latency(s): 0.00930236 2026-02-13T09:50:07.547 INFO:tasks.workunit.client.0.trial010.stdout:Max latency(s): 1.05285 2026-02-13T09:50:07.547 INFO:tasks.workunit.client.0.trial010.stdout:Min latency(s): 0.000475092 2026-02-13T09:50:07.548 INFO:tasks.workunit.client.0.trial010.stdout:after bench 2026-02-13T09:50:07.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:57: TEST_bluestore: echo 'after bench' 2026-02-13T09:50:07.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 84992 2026-02-13T09:50:07.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: sleep 1 2026-02-13T09:50:08.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:60: TEST_bluestore: kill 84992 2026-02-13T09:50:08.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 60: kill: (84992) - No such process 2026-02-13T09:50:08.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:61: TEST_bluestore: ceph osd down 0 2026-02-13T09:50:08.768 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:50:08.780 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 87175 2026-02-13T09:50:08.780 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: sleep 1 2026-02-13T09:50:09.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:62: TEST_bluestore: kill 87175 2026-02-13T09:50:09.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 62: kill: (87175) - No such process 2026-02-13T09:50:09.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:63: TEST_bluestore: ceph osd down 1 2026-02-13T09:50:09.990 INFO:tasks.workunit.client.0.trial010.stderr:osd.1 is already down. 2026-02-13T09:50:10.000 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 89322 2026-02-13T09:50:10.000 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: sleep 1 2026-02-13T09:50:11.001 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:64: TEST_bluestore: kill 89322 2026-02-13T09:50:11.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 64: kill: (89322) - No such process 2026-02-13T09:50:11.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:65: TEST_bluestore: ceph osd down 2 2026-02-13T09:50:11.211 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already down. 2026-02-13T09:50:11.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 91473 2026-02-13T09:50:11.221 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: sleep 1 2026-02-13T09:50:12.222 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:66: TEST_bluestore: kill 91473 2026-02-13T09:50:12.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 66: kill: (91473) - No such process 2026-02-13T09:50:12.224 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:67: TEST_bluestore: ceph osd down 3 2026-02-13T09:50:12.483 INFO:tasks.workunit.client.0.trial010.stderr:osd.3 is already down. 2026-02-13T09:50:12.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:70: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:50:15.909 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:15.946 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:71: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:50:19.521 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:19.556 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:72: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T09:50:22.889 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:22.925 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:73: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:50:26.357 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:26.393 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:75: TEST_bluestore: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-13T09:50:26.394 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:76: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-13T09:50:26.412 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:29.302 INFO:tasks.workunit.client.0.trial010.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-13T09:50:29.302 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-13T09:50:29.303 INFO:tasks.workunit.client.0.trial010.stdout:2 : device size 0x100000000(4 GiB) : using 0xaf376000(2.7 GiB) 2026-02-13T09:50:29.303 INFO:tasks.workunit.client.0.trial010.stdout:Expanding DB/WAL... 2026-02-13T09:50:29.303 INFO:tasks.workunit.client.0.trial010.stdout:0 : nothing to do, skipped 2026-02-13T09:50:29.303 INFO:tasks.workunit.client.0.trial010.stdout:1 : nothing to do, skipped 2026-02-13T09:50:29.303 INFO:tasks.workunit.client.0.trial010.stdout:2 : Expanding to 0x100000000(4 GiB) 2026-02-13T09:50:29.303 INFO:tasks.workunit.client.0.trial010.stdout:2 : size updated to 0x100000000(4 GiB) 2026-02-13T09:50:32.385 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:77: TEST_bluestore: truncate td/osd-bluefs-volume-ops/1/block -s 11811160064 2026-02-13T09:50:32.386 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:78: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 bluefs-bdev-expand 2026-02-13T09:50:32.404 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:35.178 INFO:tasks.workunit.client.0.trial010.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-13T09:50:35.179 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-13T09:50:35.179 INFO:tasks.workunit.client.0.trial010.stdout:2 : device size 0x2c0000000(11 GiB) : using 0x26f157000(9.7 GiB) 2026-02-13T09:50:35.179 INFO:tasks.workunit.client.0.trial010.stdout:Expanding DB/WAL... 2026-02-13T09:50:35.179 INFO:tasks.workunit.client.0.trial010.stdout:0 : nothing to do, skipped 2026-02-13T09:50:35.179 INFO:tasks.workunit.client.0.trial010.stdout:1 : nothing to do, skipped 2026-02-13T09:50:35.179 INFO:tasks.workunit.client.0.trial010.stdout:2 : Expanding to 0x2c0000000(11 GiB) 2026-02-13T09:50:35.179 INFO:tasks.workunit.client.0.trial010.stdout:2 : size updated to 0x2c0000000(11 GiB) 2026-02-13T09:50:38.215 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:79: TEST_bluestore: truncate td/osd-bluefs-volume-ops/2/block -s 4295099392 2026-02-13T09:50:38.216 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:80: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 bluefs-bdev-expand 2026-02-13T09:50:38.235 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:40.963 INFO:tasks.workunit.client.0.trial010.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-13T09:50:40.963 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-13T09:50:40.963 INFO:tasks.workunit.client.0.trial010.stdout:2 : device size 0x100020000(4.0 GiB) : using 0xaf1a5000(2.7 GiB) 2026-02-13T09:50:40.963 INFO:tasks.workunit.client.0.trial010.stdout:Expanding DB/WAL... 2026-02-13T09:50:40.963 INFO:tasks.workunit.client.0.trial010.stdout:0 : nothing to do, skipped 2026-02-13T09:50:40.963 INFO:tasks.workunit.client.0.trial010.stdout:1 : nothing to do, skipped 2026-02-13T09:50:40.963 INFO:tasks.workunit.client.0.trial010.stdout:2 : Expanding to 0x100020000(4.0 GiB) 2026-02-13T09:50:40.964 INFO:tasks.workunit.client.0.trial010.stdout:2 : size updated to 0x100020000(4.0 GiB) 2026-02-13T09:50:44.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:81: TEST_bluestore: truncate td/osd-bluefs-volume-ops/3/block -s 4293918720 2026-02-13T09:50:44.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:82: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 bluefs-bdev-expand 2026-02-13T09:50:44.025 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:46.769 INFO:tasks.workunit.client.0.trial010.stdout:0 : device size 0x20000000(512 MiB) : using 0x15d00000(349 MiB) 2026-02-13T09:50:46.769 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x40000000(1 GiB) : using 0xf00000(15 MiB) 2026-02-13T09:50:46.769 INFO:tasks.workunit.client.0.trial010.stdout:2 : device size 0xfff00000(4.0 GiB) : using 0xaf03e000(2.7 GiB) 2026-02-13T09:50:46.769 INFO:tasks.workunit.client.0.trial010.stdout:Expanding DB/WAL... 2026-02-13T09:50:46.770 INFO:tasks.workunit.client.0.trial010.stdout:0 : nothing to do, skipped 2026-02-13T09:50:46.770 INFO:tasks.workunit.client.0.trial010.stdout:1 : nothing to do, skipped 2026-02-13T09:50:46.770 INFO:tasks.workunit.client.0.trial010.stdout:2 : Expanding to 0xfff00000(4.0 GiB) 2026-02-13T09:50:46.770 INFO:tasks.workunit.client.0.trial010.stdout:2 : size updated to 0xfff00000(4.0 GiB) 2026-02-13T09:50:49.905 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:85: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:50:50.809 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:50.847 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:86: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:50:51.745 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:51.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:87: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T09:50:52.673 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:52.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:88: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:50:53.609 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:53.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:90: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-13T09:50:53.666 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:53.854 INFO:tasks.workunit.client.0.trial010.stdout:0 : device size 0x20000000(512 MiB) : using 0x1900000(25 MiB) 2026-02-13T09:50:53.854 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x40000000(1 GiB) : using 0x4100000(65 MiB) 2026-02-13T09:50:53.855 INFO:tasks.workunit.client.0.trial010.stdout:2 : device size 0x100000000(4 GiB) : using 0x2f376000(755 MiB) 2026-02-13T09:50:54.053 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:92: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/block.db --command bluefs-bdev-migrate 2026-02-13T09:50:54.066 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:54.661 INFO:tasks.workunit.client.0.trial010.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-13T09:50:54.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:97: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:50:55.469 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:55.498 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:100: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-13T09:50:55.515 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:56.113 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-13T09:50:56.119 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:105: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:50:56.933 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:56.962 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:108: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block.wal --devs-source td/osd-bluefs-volume-ops/2/block.db --dev-target td/osd-bluefs-volume-ops/2/block --command bluefs-bdev-migrate 2026-02-13T09:50:56.980 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:57.673 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-13T09:50:57.674 INFO:tasks.workunit.client.0.trial010.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-13T09:50:57.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:114: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T09:50:58.389 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:58.418 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:117: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block.wal --command bluefs-bdev-migrate 2026-02-13T09:50:58.436 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:50:58.565 INFO:tasks.workunit.client.0.trial010.stderr:Migrate to WAL device isn't supported. 2026-02-13T09:50:58.567 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:123: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-13T09:50:58.567 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:126: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:50:59.449 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:50:59.487 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:129: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-13T09:50:59.506 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:51:00.053 INFO:tasks.workunit.client.0.trial010.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-13T09:51:00.061 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:134: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:51:00.873 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:51:00.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:136: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --dev-target td/osd-bluefs-volume-ops/3/block.db --command bluefs-bdev-migrate 2026-02-13T09:51:00.920 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:51:01.341 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:141: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:51:02.109 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:51:02.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:143: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-13T09:51:02.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:51:02.141 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T09:51:02.142 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:51:02.143 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:51:02.144 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T09:51:02.145 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:51:02.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:51:02.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:51:02.146 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-13T09:51:02.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:51:02.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:51:02.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:51:02.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:51:02.162 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:02.155+0000 7f6d5d4bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:02.163 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:02.155+0000 7f6d5d4bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:02.164 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:02.155+0000 7f6d5d4bba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:02.358 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:51:02.358 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:51:02.358 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:51:02.359 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:51:02.359 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:51:02.359 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:02.359 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:51:02.359 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:51:02.360 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:02.360 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:51:02.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:02.611 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:02.603+0000 7f6d5d4bba40 -1 Falling back to public interface 2026-02-13T09:51:03.569 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:03.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:03.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:51:03.570 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:51:03.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:03.571 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:51:03.792 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:04.337 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:04.327+0000 7f6d5d4bba40 -1 osd.0 23 log_to_monitors true 2026-02-13T09:51:04.793 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:04.794 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:04.794 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:51:04.795 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:51:04.795 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:04.795 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:51:05.003 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 31 up_thru 31 down_at 23 last_clean_interval [5,23) [v2:127.0.0.1:6802/1748410757,v1:127.0.0.1:6803/1748410757] [v2:127.0.0.1:6804/1748410757,v1:127.0.0.1:6805/1748410757] exists,up 71b8264e-ce14-4228-918f-0e2a243090b0 2026-02-13T09:51:05.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:51:05.004 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:51:05.004 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:51:05.004 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T09:51:05.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:144: TEST_bluestore: osd_pid0=103085 2026-02-13T09:51:05.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:145: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-13T09:51:05.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:51:05.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:51:05.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:51:05.008 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:51:05.009 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:51:05.009 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:51:05.009 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:51:05.009 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:51:05.009 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:51:05.009 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:05.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:05.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:51:05.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-13T09:51:05.011 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:51:05.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:51:05.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:51:05.013 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-13T09:51:05.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:51:05.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:51:05.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:51:05.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:51:05.026 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:05.019+0000 7fcb1e883a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:05.028 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:05.019+0000 7fcb1e883a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:05.029 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:05.019+0000 7fcb1e883a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:05.224 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:51:05.225 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:51:05.225 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:51:05.225 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:51:05.225 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:51:05.225 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:05.225 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:51:05.226 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:51:05.226 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:05.226 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:51:05.440 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:05.459 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:05.451+0000 7fcb1e883a40 -1 Falling back to public interface 2026-02-13T09:51:06.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:06.441 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:06.441 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:51:06.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:51:06.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:06.442 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:51:06.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:07.306 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:07.299+0000 7fcb1e883a40 -1 osd.1 24 log_to_monitors true 2026-02-13T09:51:07.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:07.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:07.651 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:51:07.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:51:07.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:07.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:51:07.868 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 35 up_thru 35 down_at 25 last_clean_interval [9,24) [v2:127.0.0.1:6810/1816101161,v1:127.0.0.1:6811/1816101161] [v2:127.0.0.1:6812/1816101161,v1:127.0.0.1:6813/1816101161] exists,up b78903d7-70b5-4186-af4b-1ce1b75cce4e 2026-02-13T09:51:07.869 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:51:07.869 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:51:07.869 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:51:07.870 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-13T09:51:07.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:146: TEST_bluestore: osd_pid1=104026 2026-02-13T09:51:07.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:147: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-13T09:51:07.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:51:07.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:51:07.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:51:07.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:51:07.873 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:51:07.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:51:07.874 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:51:07.874 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:51:07.874 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:51:07.874 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:07.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:07.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:51:07.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:51:07.875 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-13T09:51:07.876 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:51:07.877 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:51:07.877 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:51:07.878 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-13T09:51:07.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:51:07.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:51:07.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:51:07.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:51:07.890 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:07.883+0000 7f80c8664a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:07.891 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:07.883+0000 7f80c8664a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:07.892 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:07.883+0000 7f80c8664a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:08.090 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:51:08.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:51:08.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:51:08.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:51:08.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:51:08.091 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:08.091 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:51:08.092 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:51:08.092 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:08.092 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:51:08.279 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:08.271+0000 7f80c8664a40 -1 Falling back to public interface 2026-02-13T09:51:08.319 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:09.320 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:09.321 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:09.321 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:51:09.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:51:09.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:09.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:51:09.534 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:10.015 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:10.006+0000 7f80c8664a40 -1 osd.2 26 log_to_monitors true 2026-02-13T09:51:10.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:10.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:10.536 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:51:10.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:51:10.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:10.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:51:10.748 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 38 up_thru 38 down_at 27 last_clean_interval [14,26) [v2:127.0.0.1:6818/3368255831,v1:127.0.0.1:6819/3368255831] [v2:127.0.0.1:6820/3368255831,v1:127.0.0.1:6821/3368255831] exists,up db644d6a-4ae3-4873-aeb8-9ab9c85e655a 2026-02-13T09:51:10.748 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:51:10.748 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:51:10.749 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:51:10.749 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-13T09:51:10.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:148: TEST_bluestore: osd_pid2=104967 2026-02-13T09:51:10.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:149: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-13T09:51:10.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:51:10.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:51:10.751 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:51:10.752 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:51:10.753 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:51:10.753 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:51:10.753 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:51:10.753 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:51:10.753 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:51:10.753 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:51:10.753 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:10.754 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:51:10.754 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:51:10.755 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-13T09:51:10.756 INFO:tasks.workunit.client.0.trial010.stdout:start osd.3 2026-02-13T09:51:10.756 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T09:51:10.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:51:10.757 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-13T09:51:10.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T09:51:10.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:51:10.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:51:10.757 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:51:10.771 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:10.762+0000 7fd22306fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:10.772 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:10.762+0000 7fd22306fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:10.773 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:10.762+0000 7fd22306fa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:51:10.966 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T09:51:10.966 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:51:10.966 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T09:51:10.966 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:51:10.966 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:51:10.966 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:10.967 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:51:10.967 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:51:10.967 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:10.968 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:51:11.184 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:11.267 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:11.258+0000 7fd22306fa40 -1 Falling back to public interface 2026-02-13T09:51:12.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:12.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:12.186 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:51:12.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:51:12.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:12.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:51:12.399 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:51:13.030 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:51:13.022+0000 7fd22306fa40 -1 osd.3 28 log_to_monitors true 2026-02-13T09:51:13.400 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:51:13.400 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:51:13.401 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:51:13.401 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:51:13.402 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:51:13.402 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:51:13.618 INFO:tasks.workunit.client.0.trial010.stdout:osd.3 up in weight 1 up_from 41 up_thru 41 down_at 29 last_clean_interval [19,28) [v2:127.0.0.1:6826/1071820761,v1:127.0.0.1:6827/1071820761] [v2:127.0.0.1:6828/1071820761,v1:127.0.0.1:6829/1071820761] exists,up 5bab6630-7079-401f-94c7-97f78bedcc3d 2026-02-13T09:51:13.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:51:13.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:51:13.619 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:51:13.619 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-13T09:51:13.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:150: TEST_bluestore: osd_pid3=105903 2026-02-13T09:51:13.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:152: TEST_bluestore: wait_for_clean 2026-02-13T09:51:13.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:51:13.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:51:13.621 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:51:13.621 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:51:13.622 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:51:13.622 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:51:13.622 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:51:13.622 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:51:13.622 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:51:13.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:51:13.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:51:13.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:51:13.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:51:13.712 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:51:13.713 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:51:13.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:51:13.934 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:51:13.934 INFO:tasks.workunit.client.0.trial010.stderr:2 2026-02-13T09:51:13.934 INFO:tasks.workunit.client.0.trial010.stderr:3' 2026-02-13T09:51:13.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:51:13.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:51:13.935 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:51:14.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=133143986180 2026-02-13T09:51:14.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 133143986180 2026-02-13T09:51:14.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180' 2026-02-13T09:51:14.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:51:14.017 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:51:14.106 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=150323855364 2026-02-13T09:51:14.106 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 150323855364 2026-02-13T09:51:14.106 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180 1-150323855364' 2026-02-13T09:51:14.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:51:14.107 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:51:14.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=163208757251 2026-02-13T09:51:14.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 163208757251 2026-02-13T09:51:14.186 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180 1-150323855364 2-163208757251' 2026-02-13T09:51:14.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:51:14.187 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T09:51:14.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=176093659139 2026-02-13T09:51:14.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 176093659139 2026-02-13T09:51:14.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-133143986180 1-150323855364 2-163208757251 3-176093659139' 2026-02-13T09:51:14.265 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:51:14.266 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-133143986180 2026-02-13T09:51:14.266 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:51:14.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:51:14.268 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-133143986180 2026-02-13T09:51:14.268 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:51:14.269 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=133143986180 2026-02-13T09:51:14.269 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 133143986180 2026-02-13T09:51:14.270 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 133143986180' 2026-02-13T09:51:14.270 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:51:14.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 133143986178 -lt 133143986180 2026-02-13T09:51:14.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:51:15.496 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:51:15.497 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:51:15.710 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 133143986178 -lt 133143986180 2026-02-13T09:51:15.710 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:51:16.711 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 299 -eq 0 ']' 2026-02-13T09:51:16.712 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:51:16.932 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 133143986181 -lt 133143986180 2026-02-13T09:51:16.932 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:51:16.933 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-150323855364 2026-02-13T09:51:16.933 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:51:16.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:51:16.935 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-150323855364 2026-02-13T09:51:16.935 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:51:16.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=150323855364 2026-02-13T09:51:16.936 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 150323855364 2026-02-13T09:51:16.937 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 150323855364' 2026-02-13T09:51:16.937 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:51:17.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 150323855364 -lt 150323855364 2026-02-13T09:51:17.147 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:51:17.147 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-163208757251 2026-02-13T09:51:17.147 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:51:17.148 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:51:17.149 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-163208757251 2026-02-13T09:51:17.149 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:51:17.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=163208757251 2026-02-13T09:51:17.151 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 163208757251' 2026-02-13T09:51:17.151 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 163208757251 2026-02-13T09:51:17.151 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:51:17.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 163208757252 -lt 163208757251 2026-02-13T09:51:17.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:51:17.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-176093659139 2026-02-13T09:51:17.376 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:51:17.377 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T09:51:17.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-176093659139 2026-02-13T09:51:17.378 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:51:17.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=176093659139 2026-02-13T09:51:17.379 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.3 seq 176093659139 2026-02-13T09:51:17.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 176093659139' 2026-02-13T09:51:17.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T09:51:17.601 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 176093659139 -lt 176093659139 2026-02-13T09:51:17.602 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:51:17.602 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:51:17.602 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:51:17.879 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-13T09:51:17.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:51:17.880 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:51:17.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:51:17.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:51:17.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:51:17.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:51:17.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:51:18.084 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-13T09:51:18.085 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:51:18.085 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:51:18.086 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:51:18.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-13T09:51:18.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:51:18.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:51:18.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:155: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-13T09:51:18.389 INFO:tasks.workunit.client.0.trial010.stdout:hints = 1 2026-02-13T09:51:18.389 INFO:tasks.workunit.client.0.trial010.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-13T09:51:18.389 INFO:tasks.workunit.client.0.trial010.stdout:Object prefix: benchmark_data_trial010_107236 2026-02-13T09:51:18.390 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:51:18.390 INFO:tasks.workunit.client.0.trial010.stdout: 0 0 0 0 0 0 - 0 2026-02-13T09:51:19.389 INFO:tasks.workunit.client.0.trial010.stdout: 1 16 10538 10522 41.0983 41.1016 0.00159231 0.00151145 2026-02-13T09:51:20.389 INFO:tasks.workunit.client.0.trial010.stdout: 2 16 20789 20773 40.5691 40.043 0.00147244 0.0015383 2026-02-13T09:51:21.390 INFO:tasks.workunit.client.0.trial010.stdout: 3 16 30400 30384 39.5598 37.543 0.00149196 0.0015779 2026-02-13T09:51:22.390 INFO:tasks.workunit.client.0.trial010.stdout: 4 16 40115 40099 39.1564 37.9492 0.00120168 0.00159438 2026-02-13T09:51:23.390 INFO:tasks.workunit.client.0.trial010.stdout: 5 16 49943 49927 39.0027 38.3906 0.00142897 0.0016006 2026-02-13T09:51:24.390 INFO:tasks.workunit.client.0.trial010.stdout: 6 16 59593 59577 38.7844 37.6953 0.00151087 0.00160974 2026-02-13T09:51:25.390 INFO:tasks.workunit.client.0.trial010.stdout: 7 16 69422 69406 38.7282 38.3945 0.002034 0.0016122 2026-02-13T09:51:26.390 INFO:tasks.workunit.client.0.trial010.stdout: 8 16 78925 78909 38.527 37.1211 0.00140533 0.00162063 2026-02-13T09:51:27.390 INFO:tasks.workunit.client.0.trial010.stdout: 9 16 88626 88610 38.4564 37.8945 0.00143712 0.00162366 2026-02-13T09:51:28.390 INFO:tasks.workunit.client.0.trial010.stdout: 10 15 98418 98403 38.4359 38.2539 0.00151525 0.00162452 2026-02-13T09:51:29.390 INFO:tasks.workunit.client.0.trial010.stdout: 11 16 107912 107896 38.3125 37.082 0.00180105 0.00162977 2026-02-13T09:51:30.390 INFO:tasks.workunit.client.0.trial010.stdout: 12 16 117460 117444 38.2277 37.2969 0.00163702 0.00163335 2026-02-13T09:51:31.390 INFO:tasks.workunit.client.0.trial010.stdout: 13 15 126909 126894 38.1264 36.9141 0.00150513 0.00163777 2026-02-13T09:51:32.390 INFO:tasks.workunit.client.0.trial010.stdout: 14 16 136523 136507 38.0851 37.5508 0.00301204 0.0016395 2026-02-13T09:51:33.391 INFO:tasks.workunit.client.0.trial010.stdout: 15 16 146163 146147 38.0563 37.6562 0.00246223 0.00164076 2026-02-13T09:51:34.391 INFO:tasks.workunit.client.0.trial010.stdout: 16 16 155612 155596 37.9845 36.9102 0.00137263 0.00164391 2026-02-13T09:51:35.391 INFO:tasks.workunit.client.0.trial010.stdout: 17 16 165226 165210 37.959 37.5547 0.00205713 0.00164503 2026-02-13T09:51:36.391 INFO:tasks.workunit.client.0.trial010.stdout: 18 16 172755 172739 37.484 29.4102 0.0520175 0.00166411 2026-02-13T09:51:37.391 INFO:tasks.workunit.client.0.trial010.stdout: 19 16 173021 173005 35.5658 1.03906 0.0447671 0.00175417 2026-02-13T09:51:38.391 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:51:38.386888+0000 min lat: 0.000531235 max lat: 0.239704 avg lat: 0.0018403 2026-02-13T09:51:38.391 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:51:38.392 INFO:tasks.workunit.client.0.trial010.stdout: 20 16 173236 173220 33.8295 0.839844 0.0828636 0.0018403 2026-02-13T09:51:39.391 INFO:tasks.workunit.client.0.trial010.stdout: 21 16 173409 173393 32.2508 0.675781 0.0905539 0.00193405 2026-02-13T09:51:40.391 INFO:tasks.workunit.client.0.trial010.stdout: 22 16 173568 173552 30.813 0.621094 0.0974655 0.00202296 2026-02-13T09:51:41.391 INFO:tasks.workunit.client.0.trial010.stdout: 23 16 181399 181383 30.8033 30.5898 0.00230103 0.00202749 2026-02-13T09:51:42.391 INFO:tasks.workunit.client.0.trial010.stdout: 24 16 190929 190913 31.0708 37.2266 0.00241802 0.00201007 2026-02-13T09:51:43.391 INFO:tasks.workunit.client.0.trial010.stdout: 25 15 200658 200643 31.3482 38.0078 0.00135077 0.00199223 2026-02-13T09:51:44.392 INFO:tasks.workunit.client.0.trial010.stdout: 26 16 210466 210450 31.6158 38.3086 0.00152928 0.00197535 2026-02-13T09:51:45.392 INFO:tasks.workunit.client.0.trial010.stdout: 27 16 220247 220231 31.8598 38.207 0.00146785 0.00196023 2026-02-13T09:51:46.392 INFO:tasks.workunit.client.0.trial010.stdout: 28 16 222978 222962 31.1029 10.668 0.102797 0.00200345 2026-02-13T09:51:47.392 INFO:tasks.workunit.client.0.trial010.stdout: 29 16 223037 223021 30.0383 0.230469 0.615103 0.00205631 2026-02-13T09:51:48.392 INFO:tasks.workunit.client.0.trial010.stdout:Total time run: 30.0013 2026-02-13T09:51:48.392 INFO:tasks.workunit.client.0.trial010.stdout:Total writes made: 228558 2026-02-13T09:51:48.392 INFO:tasks.workunit.client.0.trial010.stdout:Write size: 4096 2026-02-13T09:51:48.392 INFO:tasks.workunit.client.0.trial010.stdout:Object size: 4096 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Bandwidth (MB/sec): 29.7588 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Bandwidth: 14.6659 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Max bandwidth (MB/sec): 41.1016 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Min bandwidth (MB/sec): 0.230469 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Average IOPS: 7618 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Stddev IOPS: 3754.48 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Max IOPS: 10522 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Min IOPS: 59 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Average Latency(s): 0.00209873 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Latency(s): 0.00817214 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Max latency(s): 0.693942 2026-02-13T09:51:48.393 INFO:tasks.workunit.client.0.trial010.stdout:Min latency(s): 0.000531235 2026-02-13T09:51:48.395 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 103085 2026-02-13T09:51:48.395 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: sleep 1 2026-02-13T09:51:49.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:158: TEST_bluestore: kill 103085 2026-02-13T09:51:49.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 158: kill: (103085) - No such process 2026-02-13T09:51:49.397 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:159: TEST_bluestore: ceph osd down 0 2026-02-13T09:51:49.603 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:51:49.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 104026 2026-02-13T09:51:49.613 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: sleep 1 2026-02-13T09:51:50.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:160: TEST_bluestore: kill 104026 2026-02-13T09:51:50.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 160: kill: (104026) - No such process 2026-02-13T09:51:50.614 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:161: TEST_bluestore: ceph osd down 1 2026-02-13T09:51:50.832 INFO:tasks.workunit.client.0.trial010.stderr:osd.1 is already down. 2026-02-13T09:51:50.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 104967 2026-02-13T09:51:50.844 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: sleep 1 2026-02-13T09:51:51.845 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:162: TEST_bluestore: kill 104967 2026-02-13T09:51:51.846 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 162: kill: (104967) - No such process 2026-02-13T09:51:51.846 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:163: TEST_bluestore: ceph osd down 2 2026-02-13T09:51:52.051 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already down. 2026-02-13T09:51:52.060 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 105903 2026-02-13T09:51:52.060 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: sleep 1 2026-02-13T09:51:53.062 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:164: TEST_bluestore: kill 105903 2026-02-13T09:51:53.062 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 164: kill: (105903) - No such process 2026-02-13T09:51:53.062 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:165: TEST_bluestore: ceph osd down 3 2026-02-13T09:51:53.326 INFO:tasks.workunit.client.0.trial010.stderr:osd.3 is already down. 2026-02-13T09:51:53.338 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:168: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:51:56.358 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:51:56.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:170: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal count=512 bs=1M 2026-02-13T09:51:56.718 INFO:tasks.workunit.client.0.trial010.stderr:512+0 records in 2026-02-13T09:51:56.718 INFO:tasks.workunit.client.0.trial010.stderr:512+0 records out 2026-02-13T09:51:56.719 INFO:tasks.workunit.client.0.trial010.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.318722 s, 1.7 GB/s 2026-02-13T09:51:56.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:171: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --dev-target td/osd-bluefs-volume-ops/0/wal --command bluefs-bdev-new-wal 2026-02-13T09:51:56.735 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:51:59.546 INFO:tasks.workunit.client.0.trial010.stdout:WAL device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal 2026-02-13T09:51:59.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:175: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:52:02.678 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:52:02.728 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:178: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:52:06.054 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:52:06.095 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:180: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db count=1024 bs=1M 2026-02-13T09:52:06.719 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records in 2026-02-13T09:52:06.720 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records out 2026-02-13T09:52:06.720 INFO:tasks.workunit.client.0.trial010.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.622675 s, 1.7 GB/s 2026-02-13T09:52:06.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:181: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --dev-target td/osd-bluefs-volume-ops/1/db --command bluefs-bdev-new-db 2026-02-13T09:52:06.736 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:52:10.126 INFO:tasks.workunit.client.0.trial010.stdout:DB device added /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db 2026-02-13T09:52:10.147 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:185: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block --dev-target td/osd-bluefs-volume-ops/1/block.db --command bluefs-bdev-migrate 2026-02-13T09:52:10.163 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:52:12.961 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:190: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:52:16.490 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:52:16.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:193: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T09:52:19.362 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:52:19.398 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:195: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-db 2026-02-13T09:52:19.417 INFO:tasks.workunit.client.0.trial010.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-13T09:52:19.417 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:52:21.522 INFO:tasks.workunit.client.0.trial010.stdout:DB device added 2026-02-13T09:52:21.538 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:198: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --command bluefs-bdev-new-wal 2026-02-13T09:52:21.554 INFO:tasks.workunit.client.0.trial010.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-13T09:52:21.555 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:52:23.870 INFO:tasks.workunit.client.0.trial010.stdout:WAL device added 2026-02-13T09:52:23.891 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:201: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/block.db --command bluefs-bdev-migrate 2026-02-13T09:52:23.907 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:52:26.743 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:206: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T09:52:29.754 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:52:29.800 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:209: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:52:32.810 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:52:32.846 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:211: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --command bluefs-bdev-new-wal 2026-02-13T09:52:32.860 INFO:tasks.workunit.client.0.trial010.stdout:NOTICE: --dev-target option omitted, will allocate as a file 2026-02-13T09:52:32.860 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:52:35.186 INFO:tasks.workunit.client.0.trial010.stdout:WAL device added 2026-02-13T09:52:35.209 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:214: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block.db --dev-target td/osd-bluefs-volume-ops/3/block --command bluefs-bdev-migrate 2026-02-13T09:52:35.226 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:52:38.118 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block.db 2026-02-13T09:52:38.146 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:219: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:52:41.207 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:52:41.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:221: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-13T09:52:41.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:52:41.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:52:41.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:52:41.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:52:41.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:52:41.248 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:52:41.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:52:41.250 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:52:41.250 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:52:41.250 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:52:41.250 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T09:52:41.250 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:52:41.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:52:41.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:52:41.252 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-13T09:52:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:52:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:52:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:52:41.252 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:52:41.270 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:41.260+0000 7f344908ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:41.271 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:41.264+0000 7f344908ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:41.272 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:41.264+0000 7f344908ca40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:41.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:52:41.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:52:41.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:52:41.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:52:41.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:52:41.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:41.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:52:41.466 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:52:41.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:41.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:52:41.673 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:41.712 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:41.704+0000 7f344908ca40 -1 Falling back to public interface 2026-02-13T09:52:42.675 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:42.675 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:42.676 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:52:42.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:52:42.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:42.677 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:52:42.901 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:43.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:43.903 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:43.904 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:52:43.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:52:43.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:43.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:52:44.121 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:45.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:45.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:45.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:52:45.123 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:52:45.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:45.124 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:52:45.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:46.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:46.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:46.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:52:46.343 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:52:46.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:46.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:52:46.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:47.560 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:47.560 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:47.561 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:52:47.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:52:47.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:47.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:52:47.780 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:48.003 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:47.996+0000 7f344908ca40 -1 osd.0 44 log_to_monitors true 2026-02-13T09:52:48.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:48.782 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:48.783 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:52:48.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:52:48.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:48.783 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:52:49.002 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 52 up_thru 52 down_at 44 last_clean_interval [31,44) [v2:127.0.0.1:6802/1841570087,v1:127.0.0.1:6803/1841570087] [v2:127.0.0.1:6804/1841570087,v1:127.0.0.1:6805/1841570087] exists,up 71b8264e-ce14-4228-918f-0e2a243090b0 2026-02-13T09:52:49.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:52:49.004 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:52:49.004 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:52:49.004 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T09:52:49.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:222: TEST_bluestore: osd_pid0=113389 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:223: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:52:49.007 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:52:49.008 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:52:49.009 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:52:49.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:52:49.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:52:49.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:52:49.010 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:52:49.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:52:49.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:52:49.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:52:49.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:52:49.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:52:49.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:52:49.011 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-13T09:52:49.012 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:52:49.012 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:52:49.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:52:49.013 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-13T09:52:49.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:52:49.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:52:49.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:52:49.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:52:49.030 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:49.020+0000 7f33b2825a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:49.032 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:49.024+0000 7f33b2825a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:49.033 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:49.024+0000 7f33b2825a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:49.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:52:49.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:52:49.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:52:49.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:52:49.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:52:49.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:49.219 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:52:49.220 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:52:49.220 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:49.220 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:49.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:49.588 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:49.580+0000 7f33b2825a40 -1 Falling back to public interface 2026-02-13T09:52:50.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:50.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:50.434 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:52:50.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:52:50.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:50.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:50.644 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:51.645 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:51.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:51.646 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:52:51.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:52:51.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:51.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:51.856 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:52.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:52.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:52.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:52:52.859 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:52:52.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:52.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:53.063 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:54.065 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:54.065 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:54.065 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:52:54.066 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:52:54.066 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:54.066 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:54.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:55.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:55.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:55.274 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:52:55.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:52:55.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:55.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:55.479 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:56.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:56.481 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:52:56.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:56.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:52:56.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:56.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:56.675 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:56.668+0000 7f33b2825a40 -1 osd.1 45 log_to_monitors true 2026-02-13T09:52:56.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:57.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:57.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:57.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-13T09:52:57.704 INFO:tasks.workunit.client.0.trial010.stdout:7 2026-02-13T09:52:57.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:57.704 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:52:57.915 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 55 up_thru 55 down_at 46 last_clean_interval [35,45) [v2:127.0.0.1:6810/2392884465,v1:127.0.0.1:6811/2392884465] [v2:127.0.0.1:6812/2392884465,v1:127.0.0.1:6813/2392884465] exists,up b78903d7-70b5-4186-af4b-1ce1b75cce4e 2026-02-13T09:52:57.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:52:57.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:52:57.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:52:57.917 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-13T09:52:57.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:224: TEST_bluestore: osd_pid1=114435 2026-02-13T09:52:57.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:225: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:52:57.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:52:57.921 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:52:57.923 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:52:57.924 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:52:57.924 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-13T09:52:57.924 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:52:57.925 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:52:57.925 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:52:57.925 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-13T09:52:57.925 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:52:57.925 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:52:57.925 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:52:57.925 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:52:57.939 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:57.932+0000 7f32fab2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:57.940 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:57.932+0000 7f32fab2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:57.941 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:57.932+0000 7f32fab2da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:52:58.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:52:58.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:52:58.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:52:58.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:52:58.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:52:58.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:58.138 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:52:58.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:52:58.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:58.139 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:52:58.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:52:58.432 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:52:58.424+0000 7f32fab2da40 -1 Falling back to public interface 2026-02-13T09:52:59.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:52:59.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:52:59.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:52:59.350 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:52:59.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:52:59.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:52:59.567 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:00.569 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:00.569 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:00.569 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:53:00.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:53:00.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:00.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:53:00.784 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:01.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:01.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:01.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:53:01.786 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:53:01.787 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:01.787 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:53:02.000 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:03.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:03.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:03.002 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:53:03.003 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:53:03.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:03.003 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:53:03.211 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:04.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:04.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:04.213 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:53:04.213 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:53:04.214 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:04.214 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:53:04.430 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:04.664 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:53:04.655+0000 7f32fab2da40 -1 osd.2 47 log_to_monitors true 2026-02-13T09:53:05.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:05.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:05.432 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:53:05.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:53:05.433 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:05.433 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:53:05.642 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 58 up_thru 58 down_at 48 last_clean_interval [38,47) [v2:127.0.0.1:6818/4159262874,v1:127.0.0.1:6819/4159262874] [v2:127.0.0.1:6820/4159262874,v1:127.0.0.1:6821/4159262874] exists,up db644d6a-4ae3-4873-aeb8-9ab9c85e655a 2026-02-13T09:53:05.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:53:05.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:53:05.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:53:05.643 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-13T09:53:05.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:226: TEST_bluestore: osd_pid2=115506 2026-02-13T09:53:05.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:227: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-13T09:53:05.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:53:05.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:53:05.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:53:05.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:53:05.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:53:05.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:53:05.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:53:05.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:53:05.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:53:05.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-13T09:53:05.649 INFO:tasks.workunit.client.0.trial010.stdout:start osd.3 2026-02-13T09:53:05.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T09:53:05.650 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:53:05.651 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-13T09:53:05.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T09:53:05.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:53:05.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:53:05.651 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:53:05.670 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:53:05.659+0000 7fcbc41b9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:53:05.672 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:53:05.663+0000 7fcbc41b9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:53:05.673 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:53:05.663+0000 7fcbc41b9a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:53:05.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T09:53:05.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:53:05.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T09:53:05.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:53:05.857 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:53:05.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:05.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:53:05.858 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:53:05.858 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:05.859 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:53:06.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:06.180 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:53:06.171+0000 7fcbc41b9a40 -1 Falling back to public interface 2026-02-13T09:53:07.075 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:07.075 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:07.075 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:53:07.075 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:53:07.076 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:07.076 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:53:07.285 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:08.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:08.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:08.287 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:53:08.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:53:08.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:08.288 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:53:08.493 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:09.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:09.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:09.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:53:09.496 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:53:09.496 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:09.496 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:53:09.698 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:10.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:10.700 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:10.701 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:53:10.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:53:10.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:10.701 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:53:10.904 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:11.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:11.907 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:53:11.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:11.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:53:11.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:11.908 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:53:12.123 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:53:12.477 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:53:12.467+0000 7fcbc41b9a40 -1 osd.3 49 log_to_monitors true 2026-02-13T09:53:13.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:53:13.125 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:53:13.125 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:53:13.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:53:13.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:53:13.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:53:13.338 INFO:tasks.workunit.client.0.trial010.stdout:osd.3 up in weight 1 up_from 61 up_thru 61 down_at 50 last_clean_interval [41,49) [v2:127.0.0.1:6826/311589177,v1:127.0.0.1:6827/311589177] [v2:127.0.0.1:6828/311589177,v1:127.0.0.1:6829/311589177] exists,up 5bab6630-7079-401f-94c7-97f78bedcc3d 2026-02-13T09:53:13.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:53:13.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:53:13.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:53:13.339 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-13T09:53:13.339 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:228: TEST_bluestore: osd_pid3=116552 2026-02-13T09:53:13.340 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:231: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-13T09:53:13.358 INFO:tasks.workunit.client.0.trial010.stdout:hints = 1 2026-02-13T09:53:13.359 INFO:tasks.workunit.client.0.trial010.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-13T09:53:13.359 INFO:tasks.workunit.client.0.trial010.stdout:Object prefix: benchmark_data_trial010_117578 2026-02-13T09:53:13.359 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:53:13.359 INFO:tasks.workunit.client.0.trial010.stdout: 0 0 0 0 0 0 - 0 2026-02-13T09:53:14.359 INFO:tasks.workunit.client.0.trial010.stdout: 1 16 11220 11204 43.7621 43.7656 0.00130771 0.00142544 2026-02-13T09:53:15.359 INFO:tasks.workunit.client.0.trial010.stdout: 2 15 21833 21818 42.6099 41.4609 0.00164118 0.00146476 2026-02-13T09:53:16.359 INFO:tasks.workunit.client.0.trial010.stdout: 3 16 30447 30431 39.6206 33.6445 0.00142471 0.00157568 2026-02-13T09:53:17.359 INFO:tasks.workunit.client.0.trial010.stdout: 4 16 40809 40793 39.8338 40.4766 0.00126162 0.00156718 2026-02-13T09:53:18.359 INFO:tasks.workunit.client.0.trial010.stdout: 5 16 51581 51565 40.2821 42.0781 0.00139528 0.00154975 2026-02-13T09:53:19.359 INFO:tasks.workunit.client.0.trial010.stdout: 6 16 62039 62023 40.3765 40.8516 0.000672465 0.00154491 2026-02-13T09:53:20.359 INFO:tasks.workunit.client.0.trial010.stdout: 7 16 72402 72386 40.3909 40.4805 0.00114553 0.00154569 2026-02-13T09:53:21.359 INFO:tasks.workunit.client.0.trial010.stdout: 8 16 83117 83101 40.5736 41.8555 0.00133076 0.00153874 2026-02-13T09:53:22.359 INFO:tasks.workunit.client.0.trial010.stdout: 9 16 83771 83755 36.3493 2.55469 0.0867327 0.00170509 2026-02-13T09:53:23.359 INFO:tasks.workunit.client.0.trial010.stdout: 10 16 93073 93057 36.3477 36.3359 0.00124226 0.00171787 2026-02-13T09:53:24.359 INFO:tasks.workunit.client.0.trial010.stdout: 11 16 103604 103588 36.7828 41.1367 0.00557465 0.00169723 2026-02-13T09:53:25.359 INFO:tasks.workunit.client.0.trial010.stdout: 12 15 113516 113501 36.9443 38.7227 0.00152951 0.00169012 2026-02-13T09:53:26.359 INFO:tasks.workunit.client.0.trial010.stdout: 13 16 123345 123329 37.0553 38.3906 0.00177529 0.00168508 2026-02-13T09:53:27.360 INFO:tasks.workunit.client.0.trial010.stdout: 14 16 133091 133075 37.1276 38.0703 0.00139779 0.00168176 2026-02-13T09:53:28.360 INFO:tasks.workunit.client.0.trial010.stdout: 15 15 143080 143065 37.2538 39.0234 0.00107814 0.00167611 2026-02-13T09:53:29.360 INFO:tasks.workunit.client.0.trial010.stdout: 16 15 153015 153000 37.3508 38.8086 0.00169271 0.00167179 2026-02-13T09:53:30.360 INFO:tasks.workunit.client.0.trial010.stdout: 17 16 162969 162953 37.4405 38.8789 0.0015322 0.00166773 2026-02-13T09:53:31.360 INFO:tasks.workunit.client.0.trial010.stdout: 18 16 172745 172729 37.4818 38.1875 0.00301258 0.00166589 2026-02-13T09:53:32.360 INFO:tasks.workunit.client.0.trial010.stdout: 19 16 182579 182563 37.5307 38.4141 0.0014171 0.00166374 2026-02-13T09:53:33.360 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:53:33.354718+0000 min lat: 0.000547524 max lat: 0.140236 avg lat: 0.00171964 2026-02-13T09:53:33.360 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:53:33.360 INFO:tasks.workunit.client.0.trial010.stdout: 20 16 185645 185629 36.253 11.9766 0.0409389 0.00171964 2026-02-13T09:53:34.360 INFO:tasks.workunit.client.0.trial010.stdout: 21 16 191076 191060 35.5368 21.2148 0.00143991 0.00175717 2026-02-13T09:53:35.361 INFO:tasks.workunit.client.0.trial010.stdout: 22 15 200937 200922 35.6724 38.5234 0.00128856 0.0017505 2026-02-13T09:53:36.361 INFO:tasks.workunit.client.0.trial010.stdout: 23 16 210866 210850 35.8074 38.7812 0.00116059 0.00174388 2026-02-13T09:53:37.361 INFO:tasks.workunit.client.0.trial010.stdout: 24 15 220716 220701 35.9187 38.4805 0.0019305 0.00173847 2026-02-13T09:53:38.361 INFO:tasks.workunit.client.0.trial010.stdout: 25 16 230507 230491 36.0115 38.2422 0.00190763 0.001734 2026-02-13T09:53:39.361 INFO:tasks.workunit.client.0.trial010.stdout: 26 16 235030 235014 35.306 17.668 0.108937 0.00176233 2026-02-13T09:53:40.361 INFO:tasks.workunit.client.0.trial010.stdout: 27 16 235200 235184 34.0229 0.664062 0.1204 0.00183236 2026-02-13T09:53:41.361 INFO:tasks.workunit.client.0.trial010.stdout: 28 16 238776 238760 33.3067 13.9688 0.00141318 0.00187496 2026-02-13T09:53:42.361 INFO:tasks.workunit.client.0.trial010.stdout: 29 15 248633 248618 33.4859 38.5078 0.00174035 0.00186489 2026-02-13T09:53:43.361 INFO:tasks.workunit.client.0.trial010.stdout:Total time run: 30.0012 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Total writes made: 258445 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Write size: 4096 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Object size: 4096 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Bandwidth (MB/sec): 33.6503 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Bandwidth: 12.1647 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Max bandwidth (MB/sec): 43.7656 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Min bandwidth (MB/sec): 0.664062 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Average IOPS: 8614 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Stddev IOPS: 3114.16 2026-02-13T09:53:43.362 INFO:tasks.workunit.client.0.trial010.stdout:Max IOPS: 11204 2026-02-13T09:53:43.363 INFO:tasks.workunit.client.0.trial010.stdout:Min IOPS: 170 2026-02-13T09:53:43.363 INFO:tasks.workunit.client.0.trial010.stdout:Average Latency(s): 0.00185582 2026-02-13T09:53:43.363 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Latency(s): 0.00493558 2026-02-13T09:53:43.363 INFO:tasks.workunit.client.0.trial010.stdout:Max latency(s): 0.202717 2026-02-13T09:53:43.363 INFO:tasks.workunit.client.0.trial010.stdout:Min latency(s): 0.000547524 2026-02-13T09:53:43.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 113389 2026-02-13T09:53:43.365 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: sleep 1 2026-02-13T09:53:44.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:234: TEST_bluestore: kill 113389 2026-02-13T09:53:44.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 234: kill: (113389) - No such process 2026-02-13T09:53:44.366 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:235: TEST_bluestore: ceph osd down 0 2026-02-13T09:53:44.576 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:53:44.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 114435 2026-02-13T09:53:44.586 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: sleep 1 2026-02-13T09:53:45.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:236: TEST_bluestore: kill 114435 2026-02-13T09:53:45.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 236: kill: (114435) - No such process 2026-02-13T09:53:45.587 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:237: TEST_bluestore: ceph osd down 1 2026-02-13T09:53:45.804 INFO:tasks.workunit.client.0.trial010.stderr:osd.1 is already down. 2026-02-13T09:53:45.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 115506 2026-02-13T09:53:45.815 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: sleep 1 2026-02-13T09:53:46.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:238: TEST_bluestore: kill 115506 2026-02-13T09:53:46.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 238: kill: (115506) - No such process 2026-02-13T09:53:46.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:239: TEST_bluestore: ceph osd down 2 2026-02-13T09:53:47.027 INFO:tasks.workunit.client.0.trial010.stderr:osd.2 is already down. 2026-02-13T09:53:47.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 116552 2026-02-13T09:53:47.037 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: sleep 1 2026-02-13T09:53:48.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:240: TEST_bluestore: kill 116552 2026-02-13T09:53:48.038 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 240: kill: (116552) - No such process 2026-02-13T09:53:48.039 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:241: TEST_bluestore: ceph osd down 3 2026-02-13T09:53:48.307 INFO:tasks.workunit.client.0.trial010.stderr:osd.3 is already down. 2026-02-13T09:53:48.318 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:244: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:53:52.531 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:53:52.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:246: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/db2 count=1024 bs=1M 2026-02-13T09:53:53.226 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records in 2026-02-13T09:53:53.226 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records out 2026-02-13T09:53:53.226 INFO:tasks.workunit.client.0.trial010.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.632199 s, 1.7 GB/s 2026-02-13T09:53:53.227 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:247: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/db2 --command bluefs-bdev-migrate 2026-02-13T09:53:53.244 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:53:57.456 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-13T09:53:57.456 INFO:tasks.workunit.client.0.trial010.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/db2 2026-02-13T09:53:57.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:252: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:54:01.719 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:01.774 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:256: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/0/wal2 count=512 bs=1M 2026-02-13T09:54:02.096 INFO:tasks.workunit.client.0.trial010.stderr:512+0 records in 2026-02-13T09:54:02.096 INFO:tasks.workunit.client.0.trial010.stderr:512+0 records out 2026-02-13T09:54:02.096 INFO:tasks.workunit.client.0.trial010.stderr:536870912 bytes (537 MB, 512 MiB) copied, 0.320313 s, 1.7 GB/s 2026-02-13T09:54:02.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:257: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.wal --dev-target td/osd-bluefs-volume-ops/0/wal2 --command bluefs-bdev-migrate 2026-02-13T09:54:02.113 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:54:06.079 INFO:tasks.workunit.client.0.trial010.stdout: device removed:0 td/osd-bluefs-volume-ops/0/block.wal 2026-02-13T09:54:06.080 INFO:tasks.workunit.client.0.trial010.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/0/wal2 2026-02-13T09:54:06.110 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:261: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/0/wal 2026-02-13T09:54:06.177 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:263: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:54:10.376 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:10.438 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:266: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:54:14.643 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:14.702 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:268: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/1/db2 count=1024 bs=1M 2026-02-13T09:54:15.316 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records in 2026-02-13T09:54:15.316 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records out 2026-02-13T09:54:15.316 INFO:tasks.workunit.client.0.trial010.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.612959 s, 1.8 GB/s 2026-02-13T09:54:15.317 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:269: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --devs-source td/osd-bluefs-volume-ops/1/block.wal --dev-target td/osd-bluefs-volume-ops/1/db2 --command bluefs-bdev-migrate 2026-02-13T09:54:15.335 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:54:19.908 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-13T09:54:19.908 INFO:tasks.workunit.client.0.trial010.stdout: device removed:0 td/osd-bluefs-volume-ops/1/block.wal 2026-02-13T09:54:19.908 INFO:tasks.workunit.client.0.trial010.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/1/db2 2026-02-13T09:54:19.939 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:275: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db 2026-02-13T09:54:20.065 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:277: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:54:24.236 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:24.290 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:279: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 --devs-source td/osd-bluefs-volume-ops/1/block.db --dev-target td/osd-bluefs-volume-ops/1/block --command bluefs-bdev-migrate 2026-02-13T09:54:24.308 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:54:27.960 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/1/block.db 2026-02-13T09:54:27.992 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:284: TEST_bluestore: rm -rf td/osd-bluefs-volume-ops/1/db2 2026-02-13T09:54:28.117 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:286: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/1 fsck 2026-02-13T09:54:32.168 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:32.223 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:289: TEST_bluestore: ceph-objectstore-tool --type bluestore --data-path td/osd-bluefs-volume-ops/2 --op fsck --no-mon-config 2026-02-13T09:54:36.288 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:36.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:292: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-13T09:54:36.964 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records in 2026-02-13T09:54:36.964 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records out 2026-02-13T09:54:36.964 INFO:tasks.workunit.client.0.trial010.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.615049 s, 1.7 GB/s 2026-02-13T09:54:36.965 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:293: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-13T09:54:36.981 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:54:37.104 INFO:tasks.workunit.client.0.trial010.stderr:Unable to migrate Slow volume to new location, please allocate new DB or WAL with --bluefs-bdev-new-db(wal) command 2026-02-13T09:54:37.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:299: TEST_bluestore: '[' 1 -eq 0 ']' 2026-02-13T09:54:37.107 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:302: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T09:54:40.880 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:40.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:305: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/2/db2 count=1024 bs=1M 2026-02-13T09:54:42.259 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records in 2026-02-13T09:54:42.260 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records out 2026-02-13T09:54:42.260 INFO:tasks.workunit.client.0.trial010.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 1.17665 s, 913 MB/s 2026-02-13T09:54:42.260 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:307: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 --devs-source td/osd-bluefs-volume-ops/2/block --devs-source td/osd-bluefs-volume-ops/2/block.db --devs-source td/osd-bluefs-volume-ops/2/block.wal --dev-target td/osd-bluefs-volume-ops/2/db2 --command bluefs-bdev-migrate 2026-02-13T09:54:42.275 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:54:45.800 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/2/block.db 2026-02-13T09:54:45.800 INFO:tasks.workunit.client.0.trial010.stdout: device removed:0 td/osd-bluefs-volume-ops/2/block.wal 2026-02-13T09:54:45.800 INFO:tasks.workunit.client.0.trial010.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/2/db2 2026-02-13T09:54:45.831 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:314: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/2 fsck 2026-02-13T09:54:49.628 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:49.676 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:317: TEST_bluestore: dd if=/dev/zero of=td/osd-bluefs-volume-ops/3/wal2 count=1024 bs=1M 2026-02-13T09:54:50.287 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records in 2026-02-13T09:54:50.287 INFO:tasks.workunit.client.0.trial010.stderr:1024+0 records out 2026-02-13T09:54:50.287 INFO:tasks.workunit.client.0.trial010.stderr:1073741824 bytes (1.1 GB, 1.0 GiB) copied, 0.609618 s, 1.8 GB/s 2026-02-13T09:54:50.287 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:319: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 --devs-source td/osd-bluefs-volume-ops/3/block --devs-source td/osd-bluefs-volume-ops/3/block.wal --dev-target td/osd-bluefs-volume-ops/3/wal2 --command bluefs-bdev-migrate 2026-02-13T09:54:50.304 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:54:54.504 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/3/block 2026-02-13T09:54:54.504 INFO:tasks.workunit.client.0.trial010.stdout: device removed:0 td/osd-bluefs-volume-ops/3/block.wal 2026-02-13T09:54:54.505 INFO:tasks.workunit.client.0.trial010.stdout: device added: 1 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td/osd-bluefs-volume-ops/3/wal2 2026-02-13T09:54:54.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:325: TEST_bluestore: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/3 fsck 2026-02-13T09:54:58.412 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:54:58.463 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:327: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 0 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T09:54:58.464 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:54:58.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:54:58.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T09:54:58.467 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:54:58.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:54:58.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:54:58.468 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-13T09:54:58.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:54:58.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:54:58.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:54:58.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:54:58.484 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:54:58.476+0000 7f98540d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:54:58.486 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:54:58.476+0000 7f98540d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:54:58.487 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:54:58.476+0000 7f98540d6a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:54:58.679 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:54:58.679 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:54:58.679 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:54:58.679 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:54:58.679 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:54:58.680 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:54:58.680 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:54:58.681 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:54:58.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:54:58.681 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:54:58.894 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:54:58.917 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:54:58.908+0000 7f98540d6a40 -1 Falling back to public interface 2026-02-13T09:54:59.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:54:59.896 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:54:59.896 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:54:59.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:54:59.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:54:59.897 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:55:00.114 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:01.115 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:01.115 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:01.116 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:55:01.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:55:01.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:01.116 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:55:01.330 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:02.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:02.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:02.331 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:55:02.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:55:02.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:02.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:55:02.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:03.546 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:03.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:03.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:55:03.547 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:55:03.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:03.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:55:03.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:04.765 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:04.765 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:04.766 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:55:04.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:55:04.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:04.766 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:55:04.979 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:05.981 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:05.981 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:05.981 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:55:05.981 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:55:05.981 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:05.981 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:55:06.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:07.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:07.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:07.212 INFO:tasks.workunit.client.0.trial010.stdout:7 2026-02-13T09:55:07.213 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-13T09:55:07.213 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:07.213 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:55:07.231 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:07.220+0000 7f98540d6a40 -1 osd.0 63 log_to_monitors true 2026-02-13T09:55:07.427 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 71 up_thru 61 down_at 63 last_clean_interval [52,63) [v2:127.0.0.1:6802/3885210091,v1:127.0.0.1:6803/3885210091] [v2:127.0.0.1:6804/3885210091,v1:127.0.0.1:6805/3885210091] exists,up 71b8264e-ce14-4228-918f-0e2a243090b0 2026-02-13T09:55:07.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:55:07.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:55:07.428 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:55:07.428 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T09:55:07.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:328: TEST_bluestore: osd_pid0=123752 2026-02-13T09:55:07.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:329: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 1 2026-02-13T09:55:07.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:55:07.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:55:07.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=1 2026-02-13T09:55:07.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:55:07.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/1 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/1' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/1/journal' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:55:07.432 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:55:07.433 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:55:07.433 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:55:07.433 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:55:07.433 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:55:07.433 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:55:07.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:55:07.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:55:07.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:55:07.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:55:07.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:55:07.434 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:55:07.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:55:07.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:55:07.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:55:07.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:55:07.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/1 2026-02-13T09:55:07.435 INFO:tasks.workunit.client.0.trial010.stdout:start osd.1 2026-02-13T09:55:07.436 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.1 2026-02-13T09:55:07.436 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 1 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/1 --osd-journal=td/osd-bluefs-volume-ops/1/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:55:07.436 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/1/whoami 2026-02-13T09:55:07.436 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 1 = 1 ']' 2026-02-13T09:55:07.437 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:55:07.437 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:55:07.437 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:55:07.456 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:07.448+0000 7f738cacea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:07.458 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:07.448+0000 7f738cacea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:07.459 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:07.448+0000 7f738cacea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:07.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 1 2026-02-13T09:55:07.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:55:07.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=1 2026-02-13T09:55:07.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:55:07.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:55:07.647 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:07.648 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:55:07.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:55:07.648 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:07.649 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:07.834 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:07.824+0000 7f738cacea40 -1 Falling back to public interface 2026-02-13T09:55:07.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:08.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:08.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:08.867 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:55:08.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:55:08.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:08.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:09.081 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:10.083 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:10.083 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:10.083 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:55:10.084 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:55:10.084 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:10.084 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:10.294 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:11.296 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:11.296 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:11.296 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:55:11.297 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:55:11.297 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:11.297 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:11.506 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:12.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:12.507 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:12.508 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:55:12.508 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:55:12.509 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:12.509 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:12.729 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:13.730 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:13.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:13.731 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:55:13.731 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:55:13.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:13.732 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:13.937 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:14.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:14.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:14.938 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:55:14.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:55:14.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:14.938 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:15.147 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:16.019 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:16.008+0000 7f738cacea40 -1 osd.1 64 log_to_monitors true 2026-02-13T09:55:16.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:16.149 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:16.149 INFO:tasks.workunit.client.0.trial010.stdout:7 2026-02-13T09:55:16.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-13T09:55:16.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:16.150 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.1 up' 2026-02-13T09:55:16.366 INFO:tasks.workunit.client.0.trial010.stdout:osd.1 up in weight 1 up_from 74 up_thru 74 down_at 65 last_clean_interval [55,64) [v2:127.0.0.1:6810/3626345374,v1:127.0.0.1:6811/3626345374] [v2:127.0.0.1:6812/3626345374,v1:127.0.0.1:6813/3626345374] exists,up b78903d7-70b5-4186-af4b-1ce1b75cce4e 2026-02-13T09:55:16.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:55:16.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:55:16.367 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:55:16.367 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.1.pid 2026-02-13T09:55:16.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:330: TEST_bluestore: osd_pid1=124826 2026-02-13T09:55:16.369 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:331: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 2 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=2 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/2 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/2' 2026-02-13T09:55:16.370 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/2/journal' 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:55:16.371 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:55:16.373 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:55:16.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:55:16.374 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/2 2026-02-13T09:55:16.374 INFO:tasks.workunit.client.0.trial010.stdout:start osd.2 2026-02-13T09:55:16.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.2 2026-02-13T09:55:16.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 2 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/2 --osd-journal=td/osd-bluefs-volume-ops/2/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:55:16.375 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/2/whoami 2026-02-13T09:55:16.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 2 = 2 ']' 2026-02-13T09:55:16.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:55:16.375 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:55:16.376 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:55:16.390 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:16.380+0000 7f73630dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:16.392 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:16.380+0000 7f73630dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:16.393 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:16.384+0000 7f73630dea40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:16.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 2 2026-02-13T09:55:16.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:55:16.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=2 2026-02-13T09:55:16.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:55:16.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:55:16.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:16.579 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:55:16.580 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:55:16.580 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:16.580 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:16.793 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:16.874 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:16.864+0000 7f73630dea40 -1 Falling back to public interface 2026-02-13T09:55:17.795 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:17.795 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:17.795 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:55:17.796 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:55:17.796 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:17.796 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:18.006 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:19.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:19.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:19.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:55:19.009 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:55:19.009 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:19.009 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:19.211 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:20.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:20.213 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:20.213 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:55:20.214 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:55:20.214 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:20.214 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:20.419 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:21.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:21.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:21.421 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:55:21.422 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:55:21.422 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:21.422 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:21.626 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:22.628 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:22.628 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:22.628 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:55:22.629 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:55:22.629 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:22.629 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:22.837 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:23.838 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:23.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:23.839 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:55:23.839 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:55:23.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:23.840 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:24.048 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:24.479 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:24.467+0000 7f73630dea40 -1 osd.2 66 log_to_monitors true 2026-02-13T09:55:25.050 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:25.050 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:25.050 INFO:tasks.workunit.client.0.trial010.stdout:7 2026-02-13T09:55:25.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-13T09:55:25.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:25.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.2 up' 2026-02-13T09:55:25.267 INFO:tasks.workunit.client.0.trial010.stdout:osd.2 up in weight 1 up_from 78 up_thru 78 down_at 67 last_clean_interval [58,66) [v2:127.0.0.1:6818/3583181180,v1:127.0.0.1:6819/3583181180] [v2:127.0.0.1:6820/3583181180,v1:127.0.0.1:6821/3583181180] exists,up db644d6a-4ae3-4873-aeb8-9ab9c85e655a 2026-02-13T09:55:25.267 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:55:25.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:55:25.268 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:55:25.268 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.2.pid 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:332: TEST_bluestore: osd_pid2=125888 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:333: TEST_bluestore: activate_osd td/osd-bluefs-volume-ops 3 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=3 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/3 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 ' 2026-02-13T09:55:25.271 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/3' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/3/journal' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:55:25.272 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:55:25.273 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:55:25.274 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:55:25.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:55:25.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:55:25.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:55:25.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:55:25.274 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:55:25.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:55:25.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:55:25.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:55:25.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:55:25.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:55:25.275 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/3 2026-02-13T09:55:25.275 INFO:tasks.workunit.client.0.trial010.stdout:start osd.3 2026-02-13T09:55:25.276 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.3 2026-02-13T09:55:25.276 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 3 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/3 --osd-journal=td/osd-bluefs-volume-ops/3/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:55:25.277 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/3/whoami 2026-02-13T09:55:25.277 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 3 = 3 ']' 2026-02-13T09:55:25.277 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:55:25.277 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:55:25.277 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:55:25.292 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:25.279+0000 7f03fad4aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:25.294 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:25.283+0000 7f03fad4aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:25.294 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:25.283+0000 7f03fad4aa40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:55:25.491 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 3 2026-02-13T09:55:25.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:55:25.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=3 2026-02-13T09:55:25.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:55:25.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:55:25.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:25.492 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:55:25.493 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:55:25.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:25.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:25.702 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:25.794 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:25.783+0000 7f03fad4aa40 -1 Falling back to public interface 2026-02-13T09:55:26.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:26.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:26.703 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:55:26.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:55:26.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:26.703 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:26.918 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:27.919 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:27.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:27.920 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:55:27.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:55:27.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:27.920 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:28.136 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:29.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:29.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:29.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:55:29.138 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:55:29.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:29.138 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:29.354 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:30.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:30.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:30.356 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T09:55:30.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T09:55:30.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:30.356 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:30.568 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:31.569 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:31.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:31.570 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T09:55:31.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T09:55:31.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:31.570 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:31.784 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:32.785 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:32.785 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:32.786 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T09:55:32.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T09:55:32.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:32.786 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:33.022 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:55:33.282 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:55:33.271+0000 7f03fad4aa40 -1 osd.3 68 log_to_monitors true 2026-02-13T09:55:34.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:55:34.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:55:34.024 INFO:tasks.workunit.client.0.trial010.stdout:7 2026-02-13T09:55:34.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-13T09:55:34.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:55:34.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.3 up' 2026-02-13T09:55:34.232 INFO:tasks.workunit.client.0.trial010.stdout:osd.3 up in weight 1 up_from 81 up_thru 81 down_at 69 last_clean_interval [61,68) [v2:127.0.0.1:6826/3833464950,v1:127.0.0.1:6827/3833464950] [v2:127.0.0.1:6828/3833464950,v1:127.0.0.1:6829/3833464950] exists,up 5bab6630-7079-401f-94c7-97f78bedcc3d 2026-02-13T09:55:34.233 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:55:34.233 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:55:34.234 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:55:34.234 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: cat td/osd-bluefs-volume-ops/osd.3.pid 2026-02-13T09:55:34.234 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:334: TEST_bluestore: osd_pid3=126954 2026-02-13T09:55:34.234 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:337: TEST_bluestore: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-13T09:55:34.253 INFO:tasks.workunit.client.0.trial010.stdout:hints = 1 2026-02-13T09:55:34.253 INFO:tasks.workunit.client.0.trial010.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-13T09:55:34.253 INFO:tasks.workunit.client.0.trial010.stdout:Object prefix: benchmark_data_trial010_128005 2026-02-13T09:55:34.253 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:55:34.253 INFO:tasks.workunit.client.0.trial010.stdout: 0 0 0 0 0 0 - 0 2026-02-13T09:55:35.253 INFO:tasks.workunit.client.0.trial010.stdout: 1 16 10951 10935 42.7112 42.7148 0.00123062 0.0014603 2026-02-13T09:55:36.253 INFO:tasks.workunit.client.0.trial010.stdout: 2 16 21832 21816 42.6058 42.5039 0.00173648 0.00146482 2026-02-13T09:55:37.253 INFO:tasks.workunit.client.0.trial010.stdout: 3 15 32510 32495 42.3077 41.7148 0.00162478 0.00147548 2026-02-13T09:55:38.253 INFO:tasks.workunit.client.0.trial010.stdout: 4 16 43278 43262 42.2446 42.0586 0.000882723 0.00147765 2026-02-13T09:55:39.254 INFO:tasks.workunit.client.0.trial010.stdout: 5 16 54030 54014 42.1951 42 0.00114598 0.00147952 2026-02-13T09:55:40.254 INFO:tasks.workunit.client.0.trial010.stdout: 6 16 64716 64700 42.1191 41.7422 0.00354886 0.00148188 2026-02-13T09:55:41.253 INFO:tasks.workunit.client.0.trial010.stdout: 7 16 75285 75269 41.9994 41.2852 0.00201619 0.00148644 2026-02-13T09:55:42.254 INFO:tasks.workunit.client.0.trial010.stdout: 8 16 82879 82863 40.4572 29.6641 0.0912711 0.00153584 2026-02-13T09:55:43.254 INFO:tasks.workunit.client.0.trial010.stdout: 9 16 85540 85524 37.1168 10.3945 0.00106589 0.00168222 2026-02-13T09:55:44.254 INFO:tasks.workunit.client.0.trial010.stdout: 10 16 96062 96046 37.5149 41.1016 0.0015328 0.00166434 2026-02-13T09:55:45.254 INFO:tasks.workunit.client.0.trial010.stdout: 11 16 106673 106657 37.8721 41.4492 0.00266394 0.0016487 2026-02-13T09:55:46.254 INFO:tasks.workunit.client.0.trial010.stdout: 12 16 117161 117145 38.1299 40.9688 0.00107731 0.00163753 2026-02-13T09:55:47.254 INFO:tasks.workunit.client.0.trial010.stdout: 13 16 127490 127474 38.3002 40.3477 0.00116655 0.00163026 2026-02-13T09:55:48.254 INFO:tasks.workunit.client.0.trial010.stdout: 14 16 135990 135974 37.936 33.2031 0.0163693 0.00164132 2026-02-13T09:55:49.254 INFO:tasks.workunit.client.0.trial010.stdout: 15 16 139347 139331 36.2811 13.1133 0.00123771 0.00172107 2026-02-13T09:55:50.254 INFO:tasks.workunit.client.0.trial010.stdout: 16 16 149496 149480 36.4911 39.6445 0.00174358 0.00171117 2026-02-13T09:55:51.255 INFO:tasks.workunit.client.0.trial010.stdout: 17 16 159679 159663 36.6842 39.7773 0.00141292 0.00170215 2026-02-13T09:55:52.254 INFO:tasks.workunit.client.0.trial010.stdout: 18 16 169560 169544 36.7904 38.5977 0.00121936 0.00169726 2026-02-13T09:55:53.255 INFO:tasks.workunit.client.0.trial010.stdout: 19 16 179819 179803 36.963 40.0742 0.00115062 0.00168931 2026-02-13T09:55:54.255 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:55:54.247616+0000 min lat: 0.000523238 max lat: 0.197756 avg lat: 0.00168294 2026-02-13T09:55:54.255 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:55:54.255 INFO:tasks.workunit.client.0.trial010.stdout: 20 15 189998 189983 37.103 39.7656 0.00118377 0.00168294 2026-02-13T09:55:55.255 INFO:tasks.workunit.client.0.trial010.stdout: 21 16 200024 200008 37.2008 39.1602 0.0017282 0.00167852 2026-02-13T09:55:56.255 INFO:tasks.workunit.client.0.trial010.stdout: 22 16 210181 210165 37.3132 39.6758 0.00103643 0.00167347 2026-02-13T09:55:57.255 INFO:tasks.workunit.client.0.trial010.stdout: 23 16 220253 220237 37.4013 39.3438 0.00182864 0.0016695 2026-02-13T09:55:58.255 INFO:tasks.workunit.client.0.trial010.stdout: 24 16 230476 230460 37.5067 39.9336 0.00217408 0.00166483 2026-02-13T09:55:59.255 INFO:tasks.workunit.client.0.trial010.stdout: 25 16 239014 238998 37.3404 33.3516 0.0464356 0.00167069 2026-02-13T09:56:00.256 INFO:tasks.workunit.client.0.trial010.stdout: 26 16 239144 239128 35.9238 0.507812 0.177153 0.001733 2026-02-13T09:56:01.255 INFO:tasks.workunit.client.0.trial010.stdout: 27 16 239266 239250 34.6109 0.476562 0.154442 0.00179863 2026-02-13T09:56:02.255 INFO:tasks.workunit.client.0.trial010.stdout: 28 15 247945 247930 34.5857 33.9062 0.00167631 0.00180555 2026-02-13T09:56:03.256 INFO:tasks.workunit.client.0.trial010.stdout: 29 16 258180 258164 34.7714 39.9766 0.00104338 0.0017959 2026-02-13T09:56:04.256 INFO:tasks.workunit.client.0.trial010.stdout:Total time run: 30.001 2026-02-13T09:56:04.256 INFO:tasks.workunit.client.0.trial010.stdout:Total writes made: 268384 2026-02-13T09:56:04.256 INFO:tasks.workunit.client.0.trial010.stdout:Write size: 4096 2026-02-13T09:56:04.256 INFO:tasks.workunit.client.0.trial010.stdout:Object size: 4096 2026-02-13T09:56:04.256 INFO:tasks.workunit.client.0.trial010.stdout:Bandwidth (MB/sec): 34.9446 2026-02-13T09:56:04.256 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Bandwidth: 12.2487 2026-02-13T09:56:04.256 INFO:tasks.workunit.client.0.trial010.stdout:Max bandwidth (MB/sec): 42.7148 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Min bandwidth (MB/sec): 0.476562 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Average IOPS: 8945 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Stddev IOPS: 3135.67 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Max IOPS: 10935 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Min IOPS: 122 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Average Latency(s): 0.00178702 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Latency(s): 0.00515047 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Max latency(s): 0.251155 2026-02-13T09:56:04.257 INFO:tasks.workunit.client.0.trial010.stdout:Min latency(s): 0.000523238 2026-02-13T09:56:04.259 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:339: TEST_bluestore: wait_for_clean 2026-02-13T09:56:04.259 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:56:04.259 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:56:04.260 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:56:04.260 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:56:04.261 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:56:04.261 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:56:04.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:56:04.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:56:04.261 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:56:04.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:56:04.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:56:04.357 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:56:04.358 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:56:04.358 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:56:04.358 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:56:04.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids='0 2026-02-13T09:56:04.565 INFO:tasks.workunit.client.0.trial010.stderr:1 2026-02-13T09:56:04.565 INFO:tasks.workunit.client.0.trial010.stderr:2 2026-02-13T09:56:04.565 INFO:tasks.workunit.client.0.trial010.stderr:3' 2026-02-13T09:56:04.565 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:56:04.565 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:56:04.565 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:56:04.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=304942678030 2026-02-13T09:56:04.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 304942678030 2026-02-13T09:56:04.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678030' 2026-02-13T09:56:04.643 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:56:04.644 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.1 flush_pg_stats 2026-02-13T09:56:04.719 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=317827579916 2026-02-13T09:56:04.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 317827579916 2026-02-13T09:56:04.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678030 1-317827579916' 2026-02-13T09:56:04.720 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:56:04.720 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.2 flush_pg_stats 2026-02-13T09:56:04.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=335007449099 2026-02-13T09:56:04.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 335007449099 2026-02-13T09:56:04.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678030 1-317827579916 2-335007449099' 2026-02-13T09:56:04.798 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:56:04.799 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.3 flush_pg_stats 2026-02-13T09:56:04.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=347892350985 2026-02-13T09:56:04.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 347892350985 2026-02-13T09:56:04.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-304942678030 1-317827579916 2-335007449099 3-347892350985' 2026-02-13T09:56:04.878 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:56:04.878 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-304942678030 2026-02-13T09:56:04.879 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:56:04.880 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:56:04.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-304942678030 2026-02-13T09:56:04.881 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:56:04.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=304942678030 2026-02-13T09:56:04.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 304942678030' 2026-02-13T09:56:04.882 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 304942678030 2026-02-13T09:56:04.883 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:56:05.098 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 304942678028 -lt 304942678030 2026-02-13T09:56:05.099 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:56:06.100 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:56:06.101 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:56:06.320 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 304942678030 -lt 304942678030 2026-02-13T09:56:06.320 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:56:06.321 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 1-317827579916 2026-02-13T09:56:06.321 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:56:06.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=1 2026-02-13T09:56:06.323 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 1-317827579916 2026-02-13T09:56:06.323 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:56:06.324 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=317827579916 2026-02-13T09:56:06.324 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.1 seq 317827579916' 2026-02-13T09:56:06.325 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.1 seq 317827579916 2026-02-13T09:56:06.325 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 1 2026-02-13T09:56:06.551 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 317827579916 -lt 317827579916 2026-02-13T09:56:06.552 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:56:06.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 2-335007449099 2026-02-13T09:56:06.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:56:06.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=2 2026-02-13T09:56:06.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 2-335007449099 2026-02-13T09:56:06.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:56:06.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=335007449099 2026-02-13T09:56:06.555 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.2 seq 335007449099 2026-02-13T09:56:06.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.2 seq 335007449099' 2026-02-13T09:56:06.556 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 2 2026-02-13T09:56:07.851 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 335007449099 -lt 335007449099 2026-02-13T09:56:07.852 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:56:07.852 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 3-347892350985 2026-02-13T09:56:07.852 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:56:07.853 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=3 2026-02-13T09:56:07.854 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 3-347892350985 2026-02-13T09:56:07.854 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:56:07.855 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=347892350985 2026-02-13T09:56:07.856 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.3 seq 347892350985' 2026-02-13T09:56:07.856 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.3 seq 347892350985 2026-02-13T09:56:07.856 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 3 2026-02-13T09:56:08.074 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 347892350985 -lt 347892350985 2026-02-13T09:56:08.076 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:56:08.076 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:56:08.076 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:56:08.363 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-13T09:56:08.363 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:56:08.364 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:56:08.364 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:56:08.364 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:56:08.364 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:56:08.364 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:56:08.364 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:56:08.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-13T09:56:08.581 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:56:08.582 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:56:08.582 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:56:08.872 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:56:08.873 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:56:09.184 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:56:09.184 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:56:09.185 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:56:09.185 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:56:09.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:56:09.187 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:56:09.187 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:56:09.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:09.188 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:56:09.189 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:56:09.189 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:09.190 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:56:09.191 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:56:09.191 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T09:56:15.153 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:56:15.153 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.153 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.153 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83516 2026-02-13T09:56:15.154 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:56:15.155 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:56:15.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:56:15.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:56:15.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:56:15.158 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:56:15.158 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:56:15.159 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:56:15.159 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:56:15.160 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:56:15.160 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:56:15.160 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:56:15.161 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:15.161 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:56:15.162 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:56:15.162 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:15.163 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:56:15.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:56:15.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T09:56:15.165 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:56:15.165 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.165 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.166 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83516 2026-02-13T09:56:15.167 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:56:15.168 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:56:15.168 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-13T09:56:15.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:56:15.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.169 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.169 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83516 2026-02-13T09:56:15.170 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:56:15.171 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T09:56:15.171 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:56:15.171 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-13T09:56:15.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore2 td/osd-bluefs-volume-ops 2026-02-13T09:56:15.172 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:343: TEST_bluestore2: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:15.172 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: ulimit -n 2026-02-13T09:56:15.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:345: TEST_bluestore2: local flimit=4096 2026-02-13T09:56:15.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:346: TEST_bluestore2: '[' 4096 -lt 1536 ']' 2026-02-13T09:56:15.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: export CEPH_MON=127.0.0.1:7146 2026-02-13T09:56:15.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:349: TEST_bluestore2: CEPH_MON=127.0.0.1:7146 2026-02-13T09:56:15.173 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:350: TEST_bluestore2: export CEPH_ARGS 2026-02-13T09:56:15.173 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: uuidgen 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:351: TEST_bluestore2: CEPH_ARGS+='--fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:352: TEST_bluestore2: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:353: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:354: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:355: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:356: TEST_bluestore2: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:357: TEST_bluestore2: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:358: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-13T09:56:15.175 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:359: TEST_bluestore2: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:360: TEST_bluestore2: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:362: TEST_bluestore2: run_mon td/osd-bluefs-volume-ops a 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-13T09:56:15.176 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:15.198 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:56:15.198 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:56:15.198 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:56:15.199 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:56:15.199 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.199 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.199 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:15.199 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:56:15.230 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:56:15.231 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:56:15.231 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:56:15.231 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:56:15.231 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:56:15.232 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:56:15.232 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:56:15.232 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:56:15.232 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:56:15.232 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:56:15.232 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.232 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.233 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83516/ceph-mon.a.asok 2026-02-13T09:56:15.233 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:56:15.233 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83516/ceph-mon.a.asok config get fsid 2026-02-13T09:56:15.287 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:56:15.288 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:56:15.288 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:56:15.288 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:56:15.288 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:56:15.289 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:56:15.289 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:56:15.289 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:56:15.290 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:56:15.290 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.290 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.290 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83516/ceph-mon.a.asok 2026-02-13T09:56:15.290 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:56:15.290 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83516/ceph-mon.a.asok config get mon_host 2026-02-13T09:56:15.342 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:363: TEST_bluestore2: run_mgr td/osd-bluefs-volume-ops x 2026-02-13T09:56:15.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:15.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:56:15.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:56:15.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:56:15.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-13T09:56:15.343 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:56:15.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:56:15.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:56:15.455 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:56:15.455 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:56:15.456 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.456 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.456 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:15.456 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:56:15.457 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:56:15.479 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:364: TEST_bluestore2: run_osd td/osd-bluefs-volume-ops 0 2026-02-13T09:56:15.479 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:15.479 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:56:15.480 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:56:15.481 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:56:15.482 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T09:56:15.483 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:56:15.483 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a0689759-bb51-4944-9427-7cc830113a65 2026-02-13T09:56:15.483 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 a0689759-bb51-4944-9427-7cc830113a65 2026-02-13T09:56:15.484 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a0689759-bb51-4944-9427-7cc830113a65' 2026-02-13T09:56:15.484 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:56:15.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQA/9Y5pGjbtHBAAoysPrgEosHN5CI0RBaEhOw== 2026-02-13T09:56:15.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQA/9Y5pGjbtHBAAoysPrgEosHN5CI0RBaEhOw=="}' 2026-02-13T09:56:15.494 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a0689759-bb51-4944-9427-7cc830113a65 -i td/osd-bluefs-volume-ops/0/new.json 2026-02-13T09:56:15.610 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:56:15.618 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-13T09:56:15.620 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQA/9Y5pGjbtHBAAoysPrgEosHN5CI0RBaEhOw== --osd-uuid a0689759-bb51-4944-9427-7cc830113a65 2026-02-13T09:56:15.638 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:15.626+0000 7f3d9c8f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:15.639 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:15.626+0000 7f3d9c8f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:15.640 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:15.626+0000 7f3d9c8f0a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:15.640 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:15.626+0000 7f3d9c8f0a40 -1 bdev(0x55daca428c00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:56:15.640 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:15.626+0000 7f3d9c8f0a40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-13T09:56:17.092 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-13T09:56:17.092 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:56:17.093 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:56:17.094 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:56:17.094 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:56:17.217 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:56:17.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:56:17.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:56:17.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:56:17.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:56:17.218 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:56:17.244 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:17.230+0000 7f92cd875a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:17.246 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:17.234+0000 7f92cd875a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:17.248 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:17.234+0000 7f92cd875a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:17.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:56:17.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:56:17.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:56:17.331 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:56:17.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:56:17.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:56:17.332 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:56:17.332 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:56:17.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:56:17.333 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:56:17.450 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:56:17.770 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:17.758+0000 7f92cd875a40 -1 Falling back to public interface 2026-02-13T09:56:18.452 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:56:18.452 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:56:18.453 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:56:18.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:56:18.453 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:56:18.454 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:56:18.666 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:56:18.869 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:18.858+0000 7f92cd875a40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:56:19.668 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:56:19.668 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:56:19.668 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:56:19.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:56:19.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:56:19.669 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:56:19.884 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/1248796438,v1:127.0.0.1:6803/1248796438] [v2:127.0.0.1:6804/1248796438,v1:127.0.0.1:6805/1248796438] exists,up a0689759-bb51-4944-9427-7cc830113a65 2026-02-13T09:56:19.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:56:19.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:56:19.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:56:19.885 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T09:56:19.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:365: TEST_bluestore2: osd_pid0=129825 2026-02-13T09:56:19.886 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:367: TEST_bluestore2: sleep 5 2026-02-13T09:56:24.887 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:368: TEST_bluestore2: create_pool foo 16 2026-02-13T09:56:24.887 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-13T09:56:25.152 INFO:tasks.workunit.client.0.trial010.stderr:pool 'foo' already exists 2026-02-13T09:56:25.162 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:56:26.164 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:370: TEST_bluestore2: retry = 0 2026-02-13T09:56:26.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 370: retry: command not found 2026-02-13T09:56:26.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:371: TEST_bluestore2: [[ '' -le 5 ]] 2026-02-13T09:56:26.165 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:373: TEST_bluestore2: timeout 60 rados bench -p foo 10 write --write-omap --no-cleanup 2026-02-13T09:56:26.186 INFO:tasks.workunit.client.0.trial010.stdout:hints = 1 2026-02-13T09:56:26.188 INFO:tasks.workunit.client.0.trial010.stdout:Maintaining 16 concurrent writes of 4194304 bytes to objects of size 4194304 for up to 10 seconds or 0 objects 2026-02-13T09:56:26.188 INFO:tasks.workunit.client.0.trial010.stdout:Object prefix: benchmark_data_trial010_132185 2026-02-13T09:56:26.233 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:56:26.233 INFO:tasks.workunit.client.0.trial010.stdout: 0 0 0 0 0 0 - 0 2026-02-13T09:56:27.234 INFO:tasks.workunit.client.0.trial010.stdout: 1 16 179 163 651.939 652 0.0872949 0.0956236 2026-02-13T09:56:28.234 INFO:tasks.workunit.client.0.trial010.stdout: 2 16 379 363 725.932 800 0.0706181 0.0865392 2026-02-13T09:56:29.234 INFO:tasks.workunit.client.0.trial010.stdout: 3 16 563 547 729.268 736 0.0885503 0.0866098 2026-02-13T09:56:30.234 INFO:tasks.workunit.client.0.trial010.stdout: 4 16 739 723 722.935 704 0.101137 0.0877792 2026-02-13T09:56:31.234 INFO:tasks.workunit.client.0.trial010.stdout: 5 16 939 923 738.334 800 0.0720395 0.0863472 2026-02-13T09:56:32.234 INFO:tasks.workunit.client.0.trial010.stdout: 6 16 1123 1107 737.933 736 0.0880372 0.0863068 2026-02-13T09:56:33.234 INFO:tasks.workunit.client.0.trial010.stdout: 7 16 1299 1283 733.074 704 0.0856155 0.0868658 2026-02-13T09:56:34.235 INFO:tasks.workunit.client.0.trial010.stdout: 8 16 1483 1467 733.43 736 0.088953 0.0867055 2026-02-13T09:56:35.234 INFO:tasks.workunit.client.0.trial010.stdout: 9 16 1683 1667 740.82 800 0.0746706 0.0859359 2026-02-13T09:56:36.234 INFO:tasks.workunit.client.0.trial010.stdout: 10 16 1883 1867 746.731 800 0.081866 0.0853786 2026-02-13T09:56:37.235 INFO:tasks.workunit.client.0.trial010.stdout:Total time run: 10.0591 2026-02-13T09:56:37.235 INFO:tasks.workunit.client.0.trial010.stdout:Total writes made: 1883 2026-02-13T09:56:37.235 INFO:tasks.workunit.client.0.trial010.stdout:Write size: 4194304 2026-02-13T09:56:37.235 INFO:tasks.workunit.client.0.trial010.stdout:Object size: 4194304 2026-02-13T09:56:37.235 INFO:tasks.workunit.client.0.trial010.stdout:Bandwidth (MB/sec): 748.777 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Bandwidth: 51.9846 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Max bandwidth (MB/sec): 800 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Min bandwidth (MB/sec): 652 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Average IOPS: 187 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Stddev IOPS: 12.9962 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Max IOPS: 200 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Min IOPS: 163 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Average Latency(s): 0.0853058 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Latency(s): 0.00997175 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Max latency(s): 0.133119 2026-02-13T09:56:37.236 INFO:tasks.workunit.client.0.trial010.stdout:Min latency(s): 0.0344733 2026-02-13T09:56:37.247 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:376: TEST_bluestore2: sleep 10 2026-02-13T09:56:47.250 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-13T09:56:47.251 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: jq .bluefs.db_used_bytes 2026-02-13T09:56:47.336 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:378: TEST_bluestore2: db_used=481296384 2026-02-13T09:56:47.336 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: ceph tell osd.0 perf dump bluefs 2026-02-13T09:56:47.336 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: jq .bluefs.slow_used_bytes 2026-02-13T09:56:47.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:379: TEST_bluestore2: spilled_over=218038272 2026-02-13T09:56:47.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:380: TEST_bluestore2: (( retry+=1 )) 2026-02-13T09:56:47.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: test 218038272 -eq 0 2026-02-13T09:56:47.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:381: TEST_bluestore2: break 2026-02-13T09:56:47.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:383: TEST_bluestore2: test 218038272 -gt 0 2026-02-13T09:56:47.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 129825 2026-02-13T09:56:47.420 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: sleep 1 2026-02-13T09:56:48.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:385: TEST_bluestore2: kill 129825 2026-02-13T09:56:48.421 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 385: kill: (129825) - No such process 2026-02-13T09:56:48.422 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:386: TEST_bluestore2: ceph osd down 0 2026-02-13T09:56:48.636 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:56:48.646 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:388: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --devs-source td/osd-bluefs-volume-ops/0/block.db --dev-target td/osd-bluefs-volume-ops/0/block --command bluefs-bdev-migrate 2026-02-13T09:56:48.666 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:56:50.034 INFO:tasks.workunit.client.0.trial010.stdout: device removed:1 td/osd-bluefs-volume-ops/0/block.db 2026-02-13T09:56:50.051 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:393: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command bluefs-bdev-sizes 2026-02-13T09:56:50.070 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:56:50.486 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x100000000(4 GiB) : using 0x29608000(662 MiB) 2026-02-13T09:56:50.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:396: TEST_bluestore2: ceph-bluestore-tool --path td/osd-bluefs-volume-ops/0 --command fsck 2026-02-13T09:56:52.298 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:56:52.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:399: TEST_bluestore2: activate_osd td/osd-bluefs-volume-ops 0 2026-02-13T09:56:52.378 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T09:56:52.379 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:52.380 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T09:56:52.381 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T09:56:52.382 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:56:52.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T09:56:52.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:56:52.383 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-13T09:56:52.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T09:56:52.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T09:56:52.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T09:56:52.383 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T09:56:52.405 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:52.393+0000 7efc7e21ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:52.406 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:52.397+0000 7efc7e21ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:52.407 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:52.397+0000 7efc7e21ba40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:56:52.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T09:56:52.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:56:52.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:56:52.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:56:52.592 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:56:52.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:56:52.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:56:52.593 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:56:52.593 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:56:52.594 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:56:52.783 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:52.773+0000 7efc7e21ba40 -1 Falling back to public interface 2026-02-13T09:56:52.811 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:56:53.813 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:56:53.813 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:56:53.814 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:56:53.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:56:53.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:56:53.814 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:56:54.023 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:56:55.024 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:56:55.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:56:55.025 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:56:55.025 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:56:55.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:56:55.026 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:56:55.248 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:56:55.503 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:56:55.493+0000 7efc7e21ba40 -1 osd.0 9 log_to_monitors true 2026-02-13T09:56:56.249 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:56:56.250 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:56:56.250 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T09:56:56.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T09:56:56.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:56:56.251 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:56:56.471 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 12 up_thru 12 down_at 9 last_clean_interval [5,9) [v2:127.0.0.1:6802/3349505547,v1:127.0.0.1:6803/3349505547] [v2:127.0.0.1:6804/3349505547,v1:127.0.0.1:6805/3349505547] exists,up a0689759-bb51-4944-9427-7cc830113a65 2026-02-13T09:56:56.472 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:56:56.472 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:56:56.472 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:56:56.472 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T09:56:56.473 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:400: TEST_bluestore2: osd_pid0=133416 2026-02-13T09:56:56.474 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:402: TEST_bluestore2: wait_for_clean 2026-02-13T09:56:56.474 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T09:56:56.474 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T09:56:56.474 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T09:56:56.474 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T09:56:56.475 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T09:56:56.475 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T09:56:56.475 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T09:56:56.475 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T09:56:56.475 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T09:56:56.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T09:56:56.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T09:56:56.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T09:56:56.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T09:56:56.582 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T09:56:56.582 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T09:56:56.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-13T09:56:56.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T09:56:56.799 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T09:56:56.799 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T09:56:56.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=51539607555 2026-02-13T09:56:56.884 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 51539607555 2026-02-13T09:56:56.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-51539607555' 2026-02-13T09:56:56.885 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T09:56:56.885 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-51539607555 2026-02-13T09:56:56.885 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T09:56:56.886 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T09:56:56.887 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-51539607555 2026-02-13T09:56:56.887 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T09:56:56.889 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=51539607555 2026-02-13T09:56:56.889 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 51539607555' 2026-02-13T09:56:56.889 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 51539607555 2026-02-13T09:56:56.889 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:56:57.118 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 1 -lt 51539607555 2026-02-13T09:56:57.119 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T09:56:58.120 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T09:56:58.121 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T09:56:58.335 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 51539607555 -lt 51539607555 2026-02-13T09:56:58.336 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T09:56:58.336 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:56:58.336 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:56:58.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-13T09:56:58.611 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T09:56:58.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T09:56:58.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T09:56:58.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T09:56:58.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T09:56:58.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T09:56:58.612 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T09:56:58.817 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-13T09:56:58.818 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T09:56:58.818 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T09:56:58.818 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T09:56:59.095 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-13T09:56:59.095 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:15: run: teardown td/osd-bluefs-volume-ops 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:56:59.096 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:56:59.097 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:56:59.203 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:56:59.203 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:56:59.204 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:56:59.204 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:56:59.205 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:56:59.206 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:56:59.206 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:56:59.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:59.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:56:59.207 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:56:59.208 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:59.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:56:59.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:56:59.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T09:56:59.533 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:56:59.534 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.534 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.534 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83516 2026-02-13T09:56:59.535 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:12: run: for func in $funcs 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:13: run: setup td/osd-bluefs-volume-ops 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:122: setup: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:123: setup: teardown td/osd-bluefs-volume-ops 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs= 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T09:56:59.536 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T09:56:59.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T09:56:59.537 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T09:56:59.538 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T09:56:59.538 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T09:56:59.539 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T09:56:59.540 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T09:56:59.541 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T09:56:59.541 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T09:56:59.541 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T09:56:59.542 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:59.542 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T09:56:59.543 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T09:56:59.543 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T09:56:59.544 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T09:56:59.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o '' = 1 ']' 2026-02-13T09:56:59.545 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T09:56:59.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T09:56:59.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.547 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.547 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83516 2026-02-13T09:56:59.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T09:56:59.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T09:56:59.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:124: setup: mkdir -p td/osd-bluefs-volume-ops 2026-02-13T09:56:59.550 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: get_asok_dir 2026-02-13T09:56:59.551 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.551 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.551 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:125: setup: mkdir -p /tmp/ceph-asok.83516 2026-02-13T09:56:59.552 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: ulimit -n 2026-02-13T09:56:59.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:126: setup: '[' 4096 -le 1024 ']' 2026-02-13T09:56:59.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:129: setup: '[' -z '' ']' 2026-02-13T09:56:59.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:130: setup: trap 'teardown td/osd-bluefs-volume-ops 1' TERM HUP INT 2026-02-13T09:56:59.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: TEST_bluestore_expand td/osd-bluefs-volume-ops 2026-02-13T09:56:59.553 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:406: TEST_bluestore_expand: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.554 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: ulimit -n 2026-02-13T09:56:59.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:408: TEST_bluestore_expand: local flimit=4096 2026-02-13T09:56:59.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:409: TEST_bluestore_expand: '[' 4096 -lt 1536 ']' 2026-02-13T09:56:59.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: export CEPH_MON=127.0.0.1:7146 2026-02-13T09:56:59.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:412: TEST_bluestore_expand: CEPH_MON=127.0.0.1:7146 2026-02-13T09:56:59.555 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:413: TEST_bluestore_expand: export CEPH_ARGS 2026-02-13T09:56:59.555 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: uuidgen 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:414: TEST_bluestore_expand: CEPH_ARGS+='--fsid=6278ec21-e2c1-4a33-85d7-e18d51afeb54 --auth-supported=none ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:415: TEST_bluestore_expand: CEPH_ARGS+='--mon-host=127.0.0.1:7146 ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:416: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_size=4294967296 ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:417: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_create=true ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:418: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_db_size=1073741824 ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:419: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_block_wal_create=false ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:420: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_fsck_on_mount=true ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:421: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_size=1 ' 2026-02-13T09:56:59.557 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:422: TEST_bluestore_expand: CEPH_ARGS+='--osd_pool_default_min_size=1 ' 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:423: TEST_bluestore_expand: CEPH_ARGS+='--bluestore_debug_enforce_settings=ssd ' 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:425: TEST_bluestore_expand: run_mon td/osd-bluefs-volume-ops a 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:439: run_mon: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:440: run_mon: shift 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:441: run_mon: local id=a 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:442: run_mon: shift 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:443: run_mon: local data=td/osd-bluefs-volume-ops/a 2026-02-13T09:56:59.558 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:446: run_mon: ceph-mon --id a --mkfs --mon-data=td/osd-bluefs-volume-ops/a --run-dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.580 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: get_asok_path 2026-02-13T09:56:59.580 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:56:59.580 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:56:59.581 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:56:59.581 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.581 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.581 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:59.581 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:453: run_mon: ceph-mon --id a --osd-failsafe-full-ratio=.99 --mon-osd-full-ratio=.99 --mon-data-avail-crit=1 --mon-data-avail-warn=5 --paxos-propose-interval=0.1 --osd-crush-chooseleaf-type=0 --debug-mon 20 --debug-ms 20 --debug-paxos 20 --chdir= --mon-data=td/osd-bluefs-volume-ops/a '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --mon-cluster-log-file=td/osd-bluefs-volume-ops/log --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mon-allow-pool-delete --mon-allow-pool-size-one --osd-pool-default-pg-autoscale-mode off --mon-osd-backfillfull-ratio .99 --mon-warn-on-insecure-global-id-reclaim-allowed=false 2026-02-13T09:56:59.612 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: cat 2026-02-13T09:56:59.613 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a fsid 2026-02-13T09:56:59.613 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:56:59.614 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:56:59.614 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=fsid 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .fsid 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.615 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83516/ceph-mon.a.asok 2026-02-13T09:56:59.616 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:56:59.616 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83516/ceph-mon.a.asok config get fsid 2026-02-13T09:56:59.669 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:478: run_mon: get_config mon a mon_host 2026-02-13T09:56:59.670 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1116: get_config: local daemon=mon 2026-02-13T09:56:59.670 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1117: get_config: local id=a 2026-02-13T09:56:59.670 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1118: get_config: local config=mon_host 2026-02-13T09:56:59.671 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1123: get_config: jq -r .mon_host 2026-02-13T09:56:59.671 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: get_asok_path mon.a 2026-02-13T09:56:59.671 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name=mon.a 2026-02-13T09:56:59.671 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n mon.a ']' 2026-02-13T09:56:59.671 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: get_asok_dir 2026-02-13T09:56:59.671 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.671 INFO:tasks.workunit.client.0.trial010.stderr:////home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.672 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:109: get_asok_path: echo /tmp/ceph-asok.83516/ceph-mon.a.asok 2026-02-13T09:56:59.672 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: CEPH_ARGS= 2026-02-13T09:56:59.672 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1120: get_config: ceph --format json daemon /tmp/ceph-asok.83516/ceph-mon.a.asok config get mon_host 2026-02-13T09:56:59.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:426: TEST_bluestore_expand: run_mgr td/osd-bluefs-volume-ops x 2026-02-13T09:56:59.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:544: run_mgr: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:545: run_mgr: shift 2026-02-13T09:56:59.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:546: run_mgr: local id=x 2026-02-13T09:56:59.725 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:547: run_mgr: shift 2026-02-13T09:56:59.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:548: run_mgr: local data=td/osd-bluefs-volume-ops/x 2026-02-13T09:56:59.726 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:550: run_mgr: ceph config set mgr mgr_pool false --force 2026-02-13T09:56:59.838 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: get_asok_path 2026-02-13T09:56:59.839 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:56:59.839 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:56:59.839 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:56:59.840 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.840 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.840 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:59.840 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: realpath /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:56:59.841 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:552: run_mgr: ceph-mgr --id x --osd-failsafe-full-ratio=.99 --debug-mgr 20 --debug-objecter 20 --debug-ms 20 --debug-paxos 20 --chdir= --mgr-data=td/osd-bluefs-volume-ops/x '--log-file=td/osd-bluefs-volume-ops/$name.log' '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --run-dir=td/osd-bluefs-volume-ops '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --mgr-module-path=/home/ubuntu/cephtest/clone.client.0/src/pybind/mgr 2026-02-13T09:56:59.864 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:427: TEST_bluestore_expand: run_osd td/osd-bluefs-volume-ops 0 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:624: run_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:625: run_osd: shift 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:626: run_osd: local id=0 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:627: run_osd: shift 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:628: run_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:630: run_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=6278ec21-e2c1-4a33-85d7-e18d51afeb54 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:631: run_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:632: run_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:633: run_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:634: run_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T09:56:59.865 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:635: run_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:636: run_osd: ceph_args+=' --chdir=' 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:637: run_osd: ceph_args+= 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:638: run_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: get_asok_path 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:639: run_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T09:56:59.866 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:640: run_osd: ceph_args+=' --debug-osd=20' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:641: run_osd: ceph_args+=' --debug-ms=1' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:642: run_osd: ceph_args+=' --debug-monc=20' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:643: run_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:644: run_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:645: run_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:646: run_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:647: run_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:648: run_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:649: run_osd: ceph_args+=' ' 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:650: run_osd: ceph_args+= 2026-02-13T09:56:59.867 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:651: run_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T09:56:59.868 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: uuidgen 2026-02-13T09:56:59.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:653: run_osd: local uuid=a5c26bc2-466b-4319-b810-032f18baca0d 2026-02-13T09:56:59.868 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:654: run_osd: echo 'add osd0 a5c26bc2-466b-4319-b810-032f18baca0d' 2026-02-13T09:56:59.868 INFO:tasks.workunit.client.0.trial010.stdout:add osd0 a5c26bc2-466b-4319-b810-032f18baca0d 2026-02-13T09:56:59.869 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: ceph-authtool --gen-print-key 2026-02-13T09:56:59.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:655: run_osd: OSD_SECRET=AQBr9Y5pdzAANBAAejY8l2l0SzpV3afiJD3NtA== 2026-02-13T09:56:59.881 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:656: run_osd: echo '{"cephx_secret": "AQBr9Y5pdzAANBAAejY8l2l0SzpV3afiJD3NtA=="}' 2026-02-13T09:56:59.882 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:657: run_osd: ceph osd new a5c26bc2-466b-4319-b810-032f18baca0d -i td/osd-bluefs-volume-ops/0/new.json 2026-02-13T09:57:00.000 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:57:00.008 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:658: run_osd: rm td/osd-bluefs-volume-ops/0/new.json 2026-02-13T09:57:00.009 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:659: run_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=6278ec21-e2c1-4a33-85d7-e18d51afeb54 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops --mkfs --key AQBr9Y5pdzAANBAAejY8l2l0SzpV3afiJD3NtA== --osd-uuid a5c26bc2-466b-4319-b810-032f18baca0d 2026-02-13T09:57:00.030 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:00.021+0000 7fe7bb045a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:57:00.031 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:00.021+0000 7fe7bb045a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:57:00.032 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:00.021+0000 7fe7bb045a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:57:00.033 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:00.021+0000 7fe7bb045a40 -1 bdev(0x560ed26bac00 td/osd-bluefs-volume-ops/0/block) open stat got: (1) Operation not permitted 2026-02-13T09:57:00.033 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:00.021+0000 7fe7bb045a40 -1 bluestore(td/osd-bluefs-volume-ops/0) _read_fsid unparsable uuid 2026-02-13T09:57:01.561 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:661: run_osd: local key_fn=td/osd-bluefs-volume-ops/0/keyring 2026-02-13T09:57:01.562 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:662: run_osd: cat 2026-02-13T09:57:01.563 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:666: run_osd: echo adding osd0 key to auth repository 2026-02-13T09:57:01.563 INFO:tasks.workunit.client.0.trial010.stdout:adding osd0 key to auth repository 2026-02-13T09:57:01.564 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:667: run_osd: ceph -i td/osd-bluefs-volume-ops/0/keyring auth add osd.0 osd 'allow *' mon 'allow profile osd' mgr 'allow profile osd' 2026-02-13T09:57:01.689 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:668: run_osd: echo start osd.0 2026-02-13T09:57:01.690 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T09:57:01.690 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:669: run_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=6278ec21-e2c1-4a33-85d7-e18d51afeb54 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 --debug-ms=1 --debug-monc=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T09:57:01.691 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: ceph osd dump --format=json 2026-02-13T09:57:01.691 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: jq '.flags_set[]' 2026-02-13T09:57:01.691 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:672: run_osd: grep -q '"noup"' 2026-02-13T09:57:01.709 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:01.697+0000 7f5aac29da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:57:01.711 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:01.701+0000 7f5aac29da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:57:01.712 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:01.701+0000 7f5aac29da40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T09:57:01.801 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:675: run_osd: wait_for_osd up 0 2026-02-13T09:57:01.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T09:57:01.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T09:57:01.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T09:57:01.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T09:57:01.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:57:01.802 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T09:57:01.802 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T09:57:01.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:57:01.803 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:57:01.914 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:57:02.267 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:02.257+0000 7f5aac29da40 -1 Falling back to public interface 2026-02-13T09:57:02.915 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:57:02.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:57:02.916 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T09:57:02.916 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T09:57:02.917 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:57:02.917 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:57:03.133 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T09:57:03.366 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T09:57:03.357+0000 7f5aac29da40 -1 osd.0 0 log_to_monitors true 2026-02-13T09:57:04.135 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T09:57:04.135 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T09:57:04.136 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T09:57:04.136 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T09:57:04.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T09:57:04.137 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T09:57:04.348 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 5 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:127.0.0.1:6802/3606773714,v1:127.0.0.1:6803/3606773714] [v2:127.0.0.1:6804/3606773714,v1:127.0.0.1:6805/3606773714] exists,up a5c26bc2-466b-4319-b810-032f18baca0d 2026-02-13T09:57:04.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T09:57:04.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T09:57:04.349 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T09:57:04.349 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T09:57:04.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:428: TEST_bluestore_expand: osd_pid0=135974 2026-02-13T09:57:04.350 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:430: TEST_bluestore_expand: sleep 5 2026-02-13T09:57:09.351 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:431: TEST_bluestore_expand: create_pool foo 16 2026-02-13T09:57:09.352 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:532: create_pool: ceph osd pool create foo 16 2026-02-13T09:57:09.621 INFO:tasks.workunit.client.0.trial010.stderr:pool 'foo' already exists 2026-02-13T09:57:09.631 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:533: create_pool: sleep 1 2026-02-13T09:57:10.632 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:434: TEST_bluestore_expand: timeout 60 rados bench -p foo 30 write -b 4096 --no-cleanup 2026-02-13T09:57:10.657 INFO:tasks.workunit.client.0.trial010.stdout:hints = 1 2026-02-13T09:57:10.657 INFO:tasks.workunit.client.0.trial010.stdout:Maintaining 16 concurrent writes of 4096 bytes to objects of size 4096 for up to 30 seconds or 0 objects 2026-02-13T09:57:10.657 INFO:tasks.workunit.client.0.trial010.stdout:Object prefix: benchmark_data_trial010_138021 2026-02-13T09:57:10.657 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:57:10.657 INFO:tasks.workunit.client.0.trial010.stdout: 0 0 0 0 0 0 - 0 2026-02-13T09:57:11.656 INFO:tasks.workunit.client.0.trial010.stdout: 1 15 16064 16049 62.6865 62.6914 0.00147024 0.000995566 2026-02-13T09:57:12.657 INFO:tasks.workunit.client.0.trial010.stdout: 2 15 31996 31981 62.4581 62.2344 0.000910404 0.000999356 2026-02-13T09:57:13.657 INFO:tasks.workunit.client.0.trial010.stdout: 3 15 47833 47818 62.2582 61.8633 0.00146815 0.00100275 2026-02-13T09:57:14.657 INFO:tasks.workunit.client.0.trial010.stdout: 4 16 63427 63411 61.9201 60.9102 0.000882162 0.0010083 2026-02-13T09:57:15.657 INFO:tasks.workunit.client.0.trial010.stdout: 5 16 79137 79121 61.8086 61.3672 0.000707956 0.00101015 2026-02-13T09:57:16.657 INFO:tasks.workunit.client.0.trial010.stdout: 6 16 94670 94654 61.6191 60.6758 0.000761535 0.00101333 2026-02-13T09:57:17.657 INFO:tasks.workunit.client.0.trial010.stdout: 7 16 109791 109775 61.2538 59.0664 0.00161977 0.00101933 2026-02-13T09:57:18.657 INFO:tasks.workunit.client.0.trial010.stdout: 8 16 124259 124243 60.661 56.5156 0.00130956 0.00102932 2026-02-13T09:57:19.657 INFO:tasks.workunit.client.0.trial010.stdout: 9 16 138776 138760 60.2212 56.707 0.00107554 0.00103687 2026-02-13T09:57:20.657 INFO:tasks.workunit.client.0.trial010.stdout: 10 16 153250 153234 59.8525 56.5391 0.00119324 0.00104325 2026-02-13T09:57:21.657 INFO:tasks.workunit.client.0.trial010.stdout: 11 16 167326 167310 59.4096 54.9844 0.000905875 0.001051 2026-02-13T09:57:22.657 INFO:tasks.workunit.client.0.trial010.stdout: 12 16 181104 181088 58.9435 53.8203 0.00137732 0.00105936 2026-02-13T09:57:23.657 INFO:tasks.workunit.client.0.trial010.stdout: 13 16 194892 194876 58.5521 53.8594 0.001126 0.00106643 2026-02-13T09:57:24.658 INFO:tasks.workunit.client.0.trial010.stdout: 14 16 208581 208565 58.189 53.4727 0.00103251 0.00107311 2026-02-13T09:57:25.658 INFO:tasks.workunit.client.0.trial010.stdout: 15 16 222340 222324 57.8925 53.7461 0.00123484 0.0010786 2026-02-13T09:57:26.658 INFO:tasks.workunit.client.0.trial010.stdout: 16 16 236147 236131 57.6448 53.9336 0.00161663 0.00108324 2026-02-13T09:57:27.658 INFO:tasks.workunit.client.0.trial010.stdout: 17 16 249906 249890 57.4153 53.7461 0.000766073 0.00108759 2026-02-13T09:57:28.658 INFO:tasks.workunit.client.0.trial010.stdout: 18 16 263660 263644 57.2101 53.7266 0.00133779 0.00109149 2026-02-13T09:57:29.658 INFO:tasks.workunit.client.0.trial010.stdout: 19 16 277253 277237 56.9934 53.0977 0.00132895 0.00109564 2026-02-13T09:57:30.658 INFO:tasks.workunit.client.0.trial010.stdout:2026-02-13T09:57:30.649967+0000 min lat: 0.000337993 max lat: 0.00437803 avg lat: 0.00109932 2026-02-13T09:57:30.658 INFO:tasks.workunit.client.0.trial010.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2026-02-13T09:57:30.658 INFO:tasks.workunit.client.0.trial010.stdout: 20 15 290863 290848 56.802 53.168 0.000710961 0.00109932 2026-02-13T09:57:31.658 INFO:tasks.workunit.client.0.trial010.stdout: 21 16 304473 304457 56.6283 53.1602 0.00140516 0.0011027 2026-02-13T09:57:32.658 INFO:tasks.workunit.client.0.trial010.stdout: 22 16 318191 318175 56.4899 53.5859 0.000727952 0.00110542 2026-02-13T09:57:33.658 INFO:tasks.workunit.client.0.trial010.stdout: 23 16 331732 331716 56.3333 52.8945 0.00116661 0.00110848 2026-02-13T09:57:34.658 INFO:tasks.workunit.client.0.trial010.stdout: 24 16 344274 344258 56.0273 48.9922 0.0255249 0.00111403 2026-02-13T09:57:35.658 INFO:tasks.workunit.client.0.trial010.stdout: 25 16 344863 344847 53.8783 2.30078 0.0247771 0.00115873 2026-02-13T09:57:36.658 INFO:tasks.workunit.client.0.trial010.stdout: 26 16 345458 345442 51.8954 2.32422 0.0202988 0.00120305 2026-02-13T09:57:37.658 INFO:tasks.workunit.client.0.trial010.stdout: 27 16 346088 346072 50.0645 2.46094 0.0243838 0.00124663 2026-02-13T09:57:38.658 INFO:tasks.workunit.client.0.trial010.stdout: 28 16 346376 346360 48.3167 1.125 0.125361 0.00128902 2026-02-13T09:57:39.659 INFO:tasks.workunit.client.0.trial010.stdout: 29 16 346512 346496 46.6689 0.53125 0.121627 0.0013362 2026-02-13T09:57:40.659 INFO:tasks.workunit.client.0.trial010.stdout:Total time run: 30.0007 2026-02-13T09:57:40.659 INFO:tasks.workunit.client.0.trial010.stdout:Total writes made: 352484 2026-02-13T09:57:40.659 INFO:tasks.workunit.client.0.trial010.stdout:Write size: 4096 2026-02-13T09:57:40.659 INFO:tasks.workunit.client.0.trial010.stdout:Object size: 4096 2026-02-13T09:57:40.659 INFO:tasks.workunit.client.0.trial010.stdout:Bandwidth (MB/sec): 45.8952 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Bandwidth: 21.1498 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Max bandwidth (MB/sec): 62.6914 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Min bandwidth (MB/sec): 0.53125 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Average IOPS: 11749 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Stddev IOPS: 5414.34 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Max IOPS: 16049 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Min IOPS: 136 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Average Latency(s): 0.00136082 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Stddev Latency(s): 0.00434835 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Max latency(s): 0.159652 2026-02-13T09:57:40.660 INFO:tasks.workunit.client.0.trial010.stdout:Min latency(s): 0.000337993 2026-02-13T09:57:40.662 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:435: TEST_bluestore_expand: sleep 5 2026-02-13T09:57:45.666 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-13T09:57:45.666 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-13T09:57:45.753 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:437: TEST_bluestore_expand: total_space_before=4294967296 2026-02-13T09:57:45.754 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-13T09:57:45.755 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-13T09:57:45.755 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: grep free 2026-02-13T09:57:45.755 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d: -f 2 2026-02-13T09:57:45.755 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut -d, -f 1 2026-02-13T09:57:45.756 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-13T09:57:45.835 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:438: TEST_bluestore_expand: free_space_before=2851094528 2026-02-13T09:57:45.836 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 135974 2026-02-13T09:57:45.836 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: sleep 1 2026-02-13T09:57:46.836 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:441: TEST_bluestore_expand: kill 135974 2026-02-13T09:57:46.837 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh: line 441: kill: (135974) - No such process 2026-02-13T09:57:46.837 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:442: TEST_bluestore_expand: ceph osd down 0 2026-02-13T09:57:47.048 INFO:tasks.workunit.client.0.trial010.stderr:osd.0 is already down. 2026-02-13T09:57:47.057 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:445: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 allocmap 2026-02-13T09:57:47.072 INFO:tasks.workunit.client.0.trial010.stdout:allocmap bluestore.allocmap 2026-02-13T09:58:29.901 INFO:tasks.workunit.client.0.trial010.stdout:allocmap success 2026-02-13T09:58:29.936 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:448: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T09:59:14.893 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T09:59:14.933 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:450: TEST_bluestore_expand: requested_space=4294967296 2026-02-13T09:59:14.933 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:451: TEST_bluestore_expand: truncate td/osd-bluefs-volume-ops/0/block -s 4294967296 2026-02-13T09:59:14.934 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:452: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-expand 2026-02-13T09:59:14.959 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T09:59:56.553 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x40000000(1 GiB) : using 0x27900000(633 MiB) 2026-02-13T09:59:56.553 INFO:tasks.workunit.client.0.trial010.stdout:2 : device size 0x100000000(4 GiB) : using 0x560fe000(1.3 GiB) 2026-02-13T09:59:56.553 INFO:tasks.workunit.client.0.trial010.stdout:Expanding DB/WAL... 2026-02-13T09:59:56.553 INFO:tasks.workunit.client.0.trial010.stdout:1 : nothing to do, skipped 2026-02-13T09:59:56.553 INFO:tasks.workunit.client.0.trial010.stdout:2 : nothing to do, skipped 2026-02-13T09:59:56.696 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:455: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 fsck 2026-02-13T10:00:42.076 INFO:tasks.workunit.client.0.trial010.stdout:fsck success 2026-02-13T10:00:42.104 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:458: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 qfsck 2026-02-13T10:00:42.127 INFO:tasks.workunit.client.0.trial010.stdout:qfsck bluestore.quick-fsck 2026-02-13T10:01:24.632 INFO:tasks.workunit.client.0.trial010.stdout:qfsck success 2026-02-13T10:01:24.654 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:460: TEST_bluestore_expand: ceph-bluestore-tool --log-file td/osd-bluefs-volume-ops/bluestore_tool.log --path td/osd-bluefs-volume-ops/0 bluefs-bdev-sizes 2026-02-13T10:01:24.678 INFO:tasks.workunit.client.0.trial010.stdout:inferring bluefs devices from bluestore path 2026-02-13T10:02:07.177 INFO:tasks.workunit.client.0.trial010.stdout:1 : device size 0x40000000(1 GiB) : using 0x27900000(633 MiB) 2026-02-13T10:02:07.177 INFO:tasks.workunit.client.0.trial010.stdout:2 : device size 0x100000000(4 GiB) : using 0x560fe000(1.3 GiB) 2026-02-13T10:02:07.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:462: TEST_bluestore_expand: activate_osd td/osd-bluefs-volume-ops 0 2026-02-13T10:02:07.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:837: activate_osd: local dir=td/osd-bluefs-volume-ops 2026-02-13T10:02:07.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:838: activate_osd: shift 2026-02-13T10:02:07.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:839: activate_osd: local id=0 2026-02-13T10:02:07.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:840: activate_osd: shift 2026-02-13T10:02:07.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:841: activate_osd: local osd_data=td/osd-bluefs-volume-ops/0 2026-02-13T10:02:07.322 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:843: activate_osd: local 'ceph_args=--fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=6278ec21-e2c1-4a33-85d7-e18d51afeb54 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd ' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:844: activate_osd: ceph_args+=' --osd-failsafe-full-ratio=.99' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:845: activate_osd: ceph_args+=' --osd-journal-size=100' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:846: activate_osd: ceph_args+=' --osd-scrub-load-threshold=2000' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:847: activate_osd: ceph_args+=' --osd-data=td/osd-bluefs-volume-ops/0' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:848: activate_osd: ceph_args+=' --osd-journal=td/osd-bluefs-volume-ops/0/journal' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:849: activate_osd: ceph_args+=' --chdir=' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:850: activate_osd: ceph_args+= 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:851: activate_osd: ceph_args+=' --run-dir=td/osd-bluefs-volume-ops' 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: get_asok_path 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:107: get_asok_path: local name= 2026-02-13T10:02:07.323 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:108: get_asok_path: '[' -n '' ']' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: get_asok_dir 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:111: get_asok_path: echo '/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:852: activate_osd: ceph_args+=' --admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:853: activate_osd: ceph_args+=' --debug-osd=20' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:854: activate_osd: ceph_args+=' --log-file=td/osd-bluefs-volume-ops/$name.log' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:855: activate_osd: ceph_args+=' --pid-file=td/osd-bluefs-volume-ops/$name.pid' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:856: activate_osd: ceph_args+=' --osd-max-object-name-len=460' 2026-02-13T10:02:07.325 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:857: activate_osd: ceph_args+=' --osd-max-object-namespace-len=64' 2026-02-13T10:02:07.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:858: activate_osd: ceph_args+=' --enable-experimental-unrecoverable-data-corrupting-features=*' 2026-02-13T10:02:07.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:859: activate_osd: ceph_args+=' --osd-mclock-profile=high_recovery_ops' 2026-02-13T10:02:07.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:860: activate_osd: ceph_args+=' ' 2026-02-13T10:02:07.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:861: activate_osd: ceph_args+= 2026-02-13T10:02:07.326 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:862: activate_osd: mkdir -p td/osd-bluefs-volume-ops/0 2026-02-13T10:02:07.326 INFO:tasks.workunit.client.0.trial010.stdout:start osd.0 2026-02-13T10:02:07.327 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:864: activate_osd: echo start osd.0 2026-02-13T10:02:07.327 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:865: activate_osd: ceph-osd -i 0 --fsid=665f74b2-0abf-451d-8090-fca80b658008 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=2147483648 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_size=536870912 --bluestore_block_wal_create=true --bluestore_fsck_on_mount=true --bluestore_allocation_from_file=1 --fsid=7439996a-f56b-4a1d-87f6-13b2b2f0c382 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --fsid=6278ec21-e2c1-4a33-85d7-e18d51afeb54 --auth-supported=none --mon-host=127.0.0.1:7146 --bluestore_block_size=4294967296 --bluestore_block_db_create=true --bluestore_block_db_size=1073741824 --bluestore_block_wal_create=false --bluestore_fsck_on_mount=true --osd_pool_default_size=1 --osd_pool_default_min_size=1 --bluestore_debug_enforce_settings=ssd --osd-failsafe-full-ratio=.99 --osd-journal-size=100 --osd-scrub-load-threshold=2000 --osd-data=td/osd-bluefs-volume-ops/0 --osd-journal=td/osd-bluefs-volume-ops/0/journal --chdir= --run-dir=td/osd-bluefs-volume-ops '--admin-socket=/tmp/ceph-asok.83516/$cluster-$name.asok' --debug-osd=20 '--log-file=td/osd-bluefs-volume-ops/$name.log' '--pid-file=td/osd-bluefs-volume-ops/$name.pid' --osd-max-object-name-len=460 --osd-max-object-namespace-len=64 '--enable-experimental-unrecoverable-data-corrupting-features=*' --osd-mclock-profile=high_recovery_ops 2026-02-13T10:02:07.327 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: cat td/osd-bluefs-volume-ops/0/whoami 2026-02-13T10:02:07.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:867: activate_osd: '[' 0 = 0 ']' 2026-02-13T10:02:07.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: ceph osd dump --format=json 2026-02-13T10:02:07.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: jq '.flags_set[]' 2026-02-13T10:02:07.328 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:870: activate_osd: grep -q '"noup"' 2026-02-13T10:02:07.349 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T10:02:07.338+0000 7f06d01d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T10:02:07.351 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T10:02:07.338+0000 7f06d01d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T10:02:07.352 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T10:02:07.342+0000 7f06d01d1a40 -1 WARNING: all dangerous and experimental features are enabled. 2026-02-13T10:02:07.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:873: activate_osd: wait_for_osd up 0 2026-02-13T10:02:07.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:969: wait_for_osd: local state=up 2026-02-13T10:02:07.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:970: wait_for_osd: local id=0 2026-02-13T10:02:07.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:972: wait_for_osd: status=1 2026-02-13T10:02:07.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i=0 )) 2026-02-13T10:02:07.548 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:07.549 INFO:tasks.workunit.client.0.trial010.stdout:0 2026-02-13T10:02:07.549 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 0 2026-02-13T10:02:07.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:07.550 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:07.760 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:07.829 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T10:02:07.818+0000 7f06d01d1a40 -1 Falling back to public interface 2026-02-13T10:02:08.762 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:08.762 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:08.762 INFO:tasks.workunit.client.0.trial010.stdout:1 2026-02-13T10:02:08.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 1 2026-02-13T10:02:08.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:08.763 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:08.985 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:09.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:09.986 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:09.987 INFO:tasks.workunit.client.0.trial010.stdout:2 2026-02-13T10:02:09.987 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 2 2026-02-13T10:02:09.987 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:09.988 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:10.208 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:11.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:11.210 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:11.210 INFO:tasks.workunit.client.0.trial010.stdout:3 2026-02-13T10:02:11.211 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 3 2026-02-13T10:02:11.211 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:11.211 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:11.431 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:12.433 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:12.433 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:12.434 INFO:tasks.workunit.client.0.trial010.stdout:4 2026-02-13T10:02:12.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 4 2026-02-13T10:02:12.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:12.435 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:13.013 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:14.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:14.014 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:14.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 5 2026-02-13T10:02:14.015 INFO:tasks.workunit.client.0.trial010.stdout:5 2026-02-13T10:02:14.015 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:14.016 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:14.465 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:15.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:15.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:15.467 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 6 2026-02-13T10:02:15.467 INFO:tasks.workunit.client.0.trial010.stdout:6 2026-02-13T10:02:15.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:15.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:15.684 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:16.686 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:16.686 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:16.687 INFO:tasks.workunit.client.0.trial010.stdout:7 2026-02-13T10:02:16.688 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 7 2026-02-13T10:02:16.688 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:16.688 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:16.906 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:17.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:17.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:17.907 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 8 2026-02-13T10:02:17.908 INFO:tasks.workunit.client.0.trial010.stdout:8 2026-02-13T10:02:17.908 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:17.908 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:18.126 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:976: wait_for_osd: sleep 1 2026-02-13T10:02:19.081 INFO:tasks.workunit.client.0.trial010.stderr:2026-02-13T10:02:19.069+0000 7f06d01d1a40 -1 osd.0 10 log_to_monitors true 2026-02-13T10:02:19.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i++ )) 2026-02-13T10:02:19.127 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:973: wait_for_osd: (( i < 300 )) 2026-02-13T10:02:19.127 INFO:tasks.workunit.client.0.trial010.stdout:9 2026-02-13T10:02:19.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:974: wait_for_osd: echo 9 2026-02-13T10:02:19.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: ceph osd dump 2026-02-13T10:02:19.128 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:975: wait_for_osd: grep 'osd.0 up' 2026-02-13T10:02:19.345 INFO:tasks.workunit.client.0.trial010.stdout:osd.0 up in weight 1 up_from 13 up_thru 7 down_at 10 last_clean_interval [5,10) [v2:127.0.0.1:6802/1944367938,v1:127.0.0.1:6803/1944367938] [v2:127.0.0.1:6804/1944367938,v1:127.0.0.1:6805/1944367938] exists,up a5c26bc2-466b-4319-b810-032f18baca0d 2026-02-13T10:02:19.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:978: wait_for_osd: status=0 2026-02-13T10:02:19.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:979: wait_for_osd: break 2026-02-13T10:02:19.346 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:982: wait_for_osd: return 0 2026-02-13T10:02:19.346 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: cat td/osd-bluefs-volume-ops/osd.0.pid 2026-02-13T10:02:19.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:463: TEST_bluestore_expand: osd_pid0=140387 2026-02-13T10:02:19.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:465: TEST_bluestore_expand: wait_for_clean 2026-02-13T10:02:19.347 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1647: wait_for_clean: local cmd= 2026-02-13T10:02:19.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1648: wait_for_clean: local num_active_clean=-1 2026-02-13T10:02:19.348 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1649: wait_for_clean: local cur_active_clean 2026-02-13T10:02:19.348 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: get_timeout_delays 90 .1 2026-02-13T10:02:19.348 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: shopt -q -o xtrace 2026-02-13T10:02:19.349 INFO:tasks.workunit.client.0.trial010.stderr:///home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: echo true 2026-02-13T10:02:19.349 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1593: get_timeout_delays: local trace=true 2026-02-13T10:02:19.349 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: true 2026-02-13T10:02:19.349 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1594: get_timeout_delays: shopt -u -o xtrace 2026-02-13T10:02:19.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: delays=('0.1' '0.2' '0.4' '0.8' '1.6' '3.2' '6.4' '12.8' '15' '15' '15' '15' '4.5') 2026-02-13T10:02:19.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1650: wait_for_clean: local -a delays 2026-02-13T10:02:19.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1651: wait_for_clean: local -i loop=0 2026-02-13T10:02:19.459 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1653: wait_for_clean: flush_pg_stats 2026-02-13T10:02:19.460 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2253: flush_pg_stats: local timeout=300 2026-02-13T10:02:19.460 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ceph osd ls 2026-02-13T10:02:19.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2255: flush_pg_stats: ids=0 2026-02-13T10:02:19.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2256: flush_pg_stats: seqs= 2026-02-13T10:02:19.682 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2257: flush_pg_stats: for osd in $ids 2026-02-13T10:02:19.683 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: ceph tell osd.0 flush_pg_stats 2026-02-13T10:02:19.768 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2258: flush_pg_stats: seq=55834574851 2026-02-13T10:02:19.768 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2259: flush_pg_stats: test -z 55834574851 2026-02-13T10:02:19.768 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2263: flush_pg_stats: seqs=' 0-55834574851' 2026-02-13T10:02:19.768 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2266: flush_pg_stats: for s in $seqs 2026-02-13T10:02:19.768 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: echo 0-55834574851 2026-02-13T10:02:19.768 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: cut -d - -f 1 2026-02-13T10:02:19.770 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2267: flush_pg_stats: osd=0 2026-02-13T10:02:19.770 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: echo 0-55834574851 2026-02-13T10:02:19.770 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: cut -d - -f 2 2026-02-13T10:02:19.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2268: flush_pg_stats: seq=55834574851 2026-02-13T10:02:19.771 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2269: flush_pg_stats: echo 'waiting osd.0 seq 55834574851' 2026-02-13T10:02:19.772 INFO:tasks.workunit.client.0.trial010.stdout:waiting osd.0 seq 55834574851 2026-02-13T10:02:19.772 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T10:02:19.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 21474836490 -lt 55834574851 2026-02-13T10:02:19.984 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2271: flush_pg_stats: sleep 1 2026-02-13T10:02:20.985 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2272: flush_pg_stats: '[' 300 -eq 0 ']' 2026-02-13T10:02:20.986 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: ceph osd last-stat-seq 0 2026-02-13T10:02:21.212 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2270: flush_pg_stats: test 55834574851 -lt 55834574851 2026-02-13T10:02:21.214 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: get_num_pgs 2026-02-13T10:02:21.214 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T10:02:21.214 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T10:02:21.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1654: wait_for_clean: test 16 == 0 2026-02-13T10:02:21.495 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1658: wait_for_clean: true 2026-02-13T10:02:21.495 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: get_num_active_clean 2026-02-13T10:02:21.495 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1355: get_num_active_clean: local expression 2026-02-13T10:02:21.496 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1356: get_num_active_clean: expression+='select(contains("active") and contains("clean")) | ' 2026-02-13T10:02:21.496 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1357: get_num_active_clean: expression+='select(contains("stale") | not)' 2026-02-13T10:02:21.496 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1358: get_num_active_clean: ceph --format json pg dump pgs 2026-02-13T10:02:21.496 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1359: get_num_active_clean: jq '.pg_stats | [.[] | .state | select(contains("active") and contains("clean")) | select(contains("stale") | not)] | length' 2026-02-13T10:02:21.702 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1662: wait_for_clean: cur_active_clean=16 2026-02-13T10:02:21.702 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: get_num_pgs 2026-02-13T10:02:21.703 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: ceph --format json status 2026-02-13T10:02:21.703 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1416: get_num_pgs: jq .pgmap.num_pgs 2026-02-13T10:02:21.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: test 16 = 16 2026-02-13T10:02:21.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1663: wait_for_clean: break 2026-02-13T10:02:21.983 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:1678: wait_for_clean: return 0 2026-02-13T10:02:21.984 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: ceph tell osd.0 perf dump bluefs 2026-02-13T10:02:21.984 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: jq .bluefs.slow_total_bytes 2026-02-13T10:02:22.073 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:467: TEST_bluestore_expand: total_space_after=4294967296 2026-02-13T10:02:22.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: ceph tell osd.0 bluestore bluefs device info 2026-02-13T10:02:22.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep BDEV_SLOW -A 2 2026-02-13T10:02:22.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: grep free 2026-02-13T10:02:22.074 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d: -f 2 2026-02-13T10:02:22.075 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut -d, -f 1 2026-02-13T10:02:22.075 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: cut '-d ' -f 2 2026-02-13T10:02:22.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:468: TEST_bluestore_expand: free_space_after=2824511488 2026-02-13T10:02:22.155 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:470: TEST_bluestore_expand: '[' 4294967296 '!=' 4294967296 ']' 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:476: TEST_bluestore_expand: total_space_added=0 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:477: TEST_bluestore_expand: free_space_added=-26583040 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:479: TEST_bluestore_expand: let 'new_used_space=(0 - -26583040)' 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:480: TEST_bluestore_expand: echo 26583040 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stdout:26583040 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:482: TEST_bluestore_expand: '[' 26583040 -gt 131072 ']' 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stdout:total_space_added = 0 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:483: TEST_bluestore_expand: echo 'total_space_added = 0' 2026-02-13T10:02:22.156 INFO:tasks.workunit.client.0.trial010.stdout:free_space_added = -26583040 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:484: TEST_bluestore_expand: echo 'free_space_added = -26583040' 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:485: TEST_bluestore_expand: return 1 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh:14: run: return 1 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2403: main: code=1 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2405: main: teardown td/osd-bluefs-volume-ops 1 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:155: teardown: local dir=td/osd-bluefs-volume-ops 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:156: teardown: local dumplogs=1 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:157: teardown: kill_daemons td/osd-bluefs-volume-ops KILL 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: shopt -q -o xtrace 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: echo true 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:336: kill_daemons: local trace=true 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: true 2026-02-13T10:02:22.157 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:337: kill_daemons: shopt -u -o xtrace 2026-02-13T10:02:22.466 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:353: kill_daemons: return 0 2026-02-13T10:02:22.467 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: uname 2026-02-13T10:02:22.468 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:158: teardown: '[' Linux '!=' FreeBSD ']' 2026-02-13T10:02:22.469 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: stat -f -c %T . 2026-02-13T10:02:22.470 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:159: teardown: '[' ext2/ext3 == btrfs ']' 2026-02-13T10:02:22.470 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:162: teardown: local cores=no 2026-02-13T10:02:22.471 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: sysctl -n kernel.core_pattern 2026-02-13T10:02:22.472 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:163: teardown: local pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T10:02:22.472 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:165: teardown: '[' / = '|' ']' 2026-02-13T10:02:22.473 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: grep -q '^core\|core$' 2026-02-13T10:02:22.473 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: dirname /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T10:02:22.474 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:171: teardown: ls /home/ubuntu/cephtest/archive/coredump 2026-02-13T10:02:22.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:180: teardown: '[' no = yes -o 1 = 1 ']' 2026-02-13T10:02:22.475 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:181: teardown: '[' -n '' ']' 2026-02-13T10:02:22.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:185: teardown: mkdir -p /home/ubuntu/cephtest/archive/log 2026-02-13T10:02:22.476 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:186: teardown: mv td/osd-bluefs-volume-ops/bluestore_tool.log td/osd-bluefs-volume-ops/mgr.x.log td/osd-bluefs-volume-ops/mon.a.log td/osd-bluefs-volume-ops/osd.0.log /home/ubuntu/cephtest/archive/log 2026-02-13T10:02:22.478 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:189: teardown: rm -fr td/osd-bluefs-volume-ops 2026-02-13T10:02:22.541 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: get_asok_dir 2026-02-13T10:02:22.542 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:99: get_asok_dir: '[' -n '' ']' 2026-02-13T10:02:22.542 INFO:tasks.workunit.client.0.trial010.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:102: get_asok_dir: echo /tmp/ceph-asok.83516 2026-02-13T10:02:22.542 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:190: teardown: rm -rf /tmp/ceph-asok.83516 2026-02-13T10:02:22.543 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:191: teardown: '[' no = yes ']' 2026-02-13T10:02:22.543 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:198: teardown: return 0 2026-02-13T10:02:22.543 INFO:tasks.workunit.client.0.trial010.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/ceph-helpers.sh:2406: main: return 1 2026-02-13T10:02:22.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T10:02:22.544 INFO:tasks.workunit:Stopping ['osd'] on client.0... 2026-02-13T10:02:22.544 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-13T10:02:22.866 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa/tasks/workunit.py", line 144, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa/tasks/workunit.py", line 292, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_ceph_ceph-c_3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb/qa/tasks/workunit.py", line 433, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/remote.py", line 575, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 461, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial010 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh' 2026-02-13T10:02:22.872 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T10:02:22.894 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T10:02:22.894 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T10:02:22.997 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T10:02:23.010 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T10:02:23.010 DEBUG:teuthology.orchestra.run.trial010:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T10:02:23.086 INFO:teuthology.orchestra.run.trial010.stdout: remote refid st t when poll reach delay offset jitter 2026-02-13T10:02:23.086 INFO:teuthology.orchestra.run.trial010.stdout:============================================================================== 2026-02-13T10:02:23.087 INFO:teuthology.orchestra.run.trial010.stdout:+ntp1.glypnod.co 169.229.128.134 2 u 53 64 377 67.095 +7.104 1.105 2026-02-13T10:02:23.087 INFO:teuthology.orchestra.run.trial010.stdout:+ntp.maxhost.io 132.163.97.4 2 u 49 64 377 69.684 +4.866 5.160 2026-02-13T10:02:23.087 INFO:teuthology.orchestra.run.trial010.stdout:-192-155-94-72.i 130.207.244.240 2 u 47 64 377 19.835 +7.136 1.195 2026-02-13T10:02:23.087 INFO:teuthology.orchestra.run.trial010.stdout:*as393746.mci.tr 42.20.202.230 2 u 57 64 377 29.878 +8.205 1.699 2026-02-13T10:02:23.087 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T10:02:23.098 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T10:02:23.098 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T10:02:23.111 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T10:02:23.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T10:02:23.140 INFO:teuthology.task.internal:Duration was 1490.824020 seconds 2026-02-13T10:02:23.140 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T10:02:23.156 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T10:02:23.156 DEBUG:teuthology.orchestra.run.trial010:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T10:02:23.182 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T10:02:23.182 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial010.front.sepia.ceph.com 2026-02-13T10:02:23.183 DEBUG:teuthology.orchestra.run.trial010:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T10:02:23.229 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T10:02:23.229 DEBUG:teuthology.orchestra.run.trial010:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T10:02:23.406 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T10:02:23.407 DEBUG:teuthology.orchestra.run.trial010:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T10:02:23.415 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T10:02:23.416 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T10:02:23.416 INFO:teuthology.orchestra.run.trial010.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T10:02:23.416 INFO:teuthology.orchestra.run.trial010.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T10:02:23.416 INFO:teuthology.orchestra.run.trial010.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: /home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T10:02:23.458 INFO:teuthology.orchestra.run.trial010.stderr: 82.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T10:02:23.460 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T10:02:23.476 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T10:02:23.476 DEBUG:teuthology.orchestra.run.trial010:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T10:02:23.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T10:02:23.527 DEBUG:teuthology.orchestra.run.trial010:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T10:02:23.563 INFO:teuthology.orchestra.run.trial010.stdout:kernel.core_pattern = core 2026-02-13T10:02:23.573 DEBUG:teuthology.orchestra.run.trial010:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T10:02:23.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T10:02:23.619 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T10:02:23.636 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T10:02:23.638 DEBUG:teuthology.misc:Transferring archived files from trial010:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/skanta-2026-02-13_01:43:11-rados-wip-bharath17-testing-2026-02-12-0618-tentacle-distro-default-trial/47936/remote/trial010 2026-02-13T10:02:23.640 DEBUG:teuthology.orchestra.run.trial010:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T10:52:33.250 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T10:52:33.251 DEBUG:teuthology.orchestra.run.trial010:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T10:52:36.842 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T10:52:36.861 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T10:52:36.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T10:52:36.878 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T10:52:36.878 DEBUG:teuthology.orchestra.run.trial010:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T10:52:36.883 INFO:teuthology.orchestra.run.trial010.stdout: 1180220 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 13 10:52 /home/ubuntu/cephtest 2026-02-13T10:52:36.884 INFO:teuthology.orchestra.run.trial010.stdout: 1189813 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 13 09:39 /home/ubuntu/cephtest/mnt.0 2026-02-13T10:52:36.884 INFO:teuthology.orchestra.run.trial010.stdout: 1189814 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 13 09:49 /home/ubuntu/cephtest/mnt.0/client.0 2026-02-13T10:52:36.884 INFO:teuthology.orchestra.run.trial010.stdout: 1205474 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Feb 13 09:49 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-13T10:52:36.884 INFO:teuthology.orchestra.run.trial010.stdout: 1205475 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Feb 13 10:02 /home/ubuntu/cephtest/mnt.0/client.0/tmp/td 2026-02-13T10:52:36.885 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T10:52:36.885 INFO:teuthology.orchestra.run.trial010.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2026-02-13T10:52:36.886 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 485, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_8bec0da71becad44414c54979f64c9ef0e7099c6/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on trial010 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-13T10:52:36.889 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T10:52:36.905 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T10:52:36.923 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on trial010 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2026-02-13T10:52:36.929 INFO:teuthology.run:Summary data: description: rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} duration: 1490.8240201473236 failure_reason: 'Command failed (workunit test osd/osd-bluefs-volume-ops.sh) on trial010 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3b40640f18f2d34a761ee9b6dba2dfbb2a3118eb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-bluefs-volume-ops.sh''' flavor: default owner: scheduled_skanta@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T10:52:36.930 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T10:52:37.065 INFO:teuthology.run:FAIL